2024-04-09T11:44:11.790 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-09T11:44:11.790 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi --verbose --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} --archive /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481 --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/orig.config.yaml 2024-04-09T11:44:11.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T11:44:11.920 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481 branch: reef-release description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7647481' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: reef-release ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async osd heartbeat grace: 80 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 120 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request sha1: d540ebaca6b131a1dd560e7f69e024b133bbaa42 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: debuginfo: true flavor: default sha1: d540ebaca6b131a1dd560e7f69e024b133bbaa42 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef-release sha1: d540ebaca6b131a1dd560e7f69e024b133bbaa42 owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9468 sha1: d540ebaca6b131a1dd560e7f69e024b133bbaa42 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: reef-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d540ebaca6b131a1dd560e7f69e024b133bbaa42 targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLd2rczFXtkBnExxc0wZ72DLZ2Oqx6t/y18wJm1SSm5q4Ov//fg3U+yoWqWxOembOfhrNsDo4XkL9WIYm6C+1s8= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMaUdtGkoG7u+mxCWB37j6LeAe+SEueeretaHrosLTHPOFvisXpgRARVqzn3jMm0wfpB3sEfQteZWNHSCb2ai7s= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-09_01:16:20 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-09T11:44:11.920 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa; will attempt to use it 2024-04-09T11:44:11.920 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks 2024-04-09T11:44:11.920 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-09T11:44:11.922 INFO:teuthology.task.internal:Checking packages... 2024-04-09T11:44:11.945 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd540ebaca6b131a1dd560e7f69e024b133bbaa42' 2024-04-09T11:44:11.945 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-09T11:44:11.945 INFO:teuthology.packaging:ref: None 2024-04-09T11:44:11.945 INFO:teuthology.packaging:tag: None 2024-04-09T11:44:11.945 INFO:teuthology.packaging:branch: reef-release 2024-04-09T11:44:11.945 INFO:teuthology.packaging:sha1: d540ebaca6b131a1dd560e7f69e024b133bbaa42 2024-04-09T11:44:11.945 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef-release 2024-04-09T11:44:12.090 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1187.gd540ebac 2024-04-09T11:44:12.091 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-09T11:44:12.102 INFO:teuthology.task.internal:no buildpackages task found 2024-04-09T11:44:12.103 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-09T11:44:12.164 INFO:teuthology.task.internal:Saving configuration 2024-04-09T11:44:12.178 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-09T11:44:12.188 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-09T11:44:12.214 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-09 11:38:52.634389', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLd2rczFXtkBnExxc0wZ72DLZ2Oqx6t/y18wJm1SSm5q4Ov//fg3U+yoWqWxOembOfhrNsDo4XkL9WIYm6C+1s8='} 2024-04-09T11:44:12.237 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-09 11:38:52.631298', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMaUdtGkoG7u+mxCWB37j6LeAe+SEueeretaHrosLTHPOFvisXpgRARVqzn3jMm0wfpB3sEfQteZWNHSCb2ai7s='} 2024-04-09T11:44:12.237 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-09T11:44:12.248 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-04-09T11:44:12.248 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-09T11:44:12.248 INFO:teuthology.run_tasks:Running task console_log... 2024-04-09T11:44:12.326 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fad7d2f8e50>, signals=[15]) 2024-04-09T11:44:12.327 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-09T11:44:12.338 INFO:teuthology.task.internal:Opening connections... 2024-04-09T11:44:12.338 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-04-09T11:44:12.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T11:44:12.445 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-04-09T11:44:12.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T11:44:12.535 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-09T11:44:12.546 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-04-09T11:44:12.563 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-04-09T11:44:12.564 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-09T11:44:12.621 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-04-09T11:44:12.621 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-04-09T11:44:12.621 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-04-09T11:44:12.621 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-04-09T11:44:12.621 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-04-09T11:44:12.621 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-04-09T11:44:12.621 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-09T11:44:12.621 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-04-09T11:44:12.621 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-04-09T11:44:12.622 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-09T11:44:12.622 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-04-09T11:44:12.622 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-09T11:44:12.622 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-09T11:44:12.622 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-09T11:44:12.622 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-09T11:44:12.644 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-04-09T11:44:12.661 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-04-09T11:44:12.662 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-04-09T11:44:12.719 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-04-09T11:44:12.719 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-04-09T11:44:12.719 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-04-09T11:44:12.719 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-04-09T11:44:12.719 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-04-09T11:44:12.719 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-04-09T11:44:12.720 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-09T11:44:12.720 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-04-09T11:44:12.720 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-04-09T11:44:12.720 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-09T11:44:12.720 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-04-09T11:44:12.720 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-09T11:44:12.720 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-09T11:44:12.720 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-09T11:44:12.720 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-04-09T11:44:12.743 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-09T11:44:12.753 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-09T11:44:12.764 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-09T11:44:12.765 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-04-09T11:44:12.767 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-04-09T11:44:12.783 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-09T11:44:12.791 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-09T11:44:12.792 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-04-09T11:44:12.824 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-04-09T11:44:12.901 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-09T11:44:12.955 INFO:teuthology.run_tasks:Running task kernel... 2024-04-09T11:44:12.971 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-09T11:44:12.971 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-09T11:44:12.972 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-09T11:44:12.972 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-09T11:44:12.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-09T11:44:12.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-09T11:44:12.990 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-09T11:44:12.991 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-04-09T11:44:13.047 INFO:teuthology.orchestra.run.smithi173.stdout:5.14.0-361.el9.x86_64 2024-04-09T11:44:13.048 INFO:teuthology.task.kernel:Running kernel on smithi173: 5.14.0-361.el9.x86_64 2024-04-09T11:44:13.048 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum install -y kernel 2024-04-09T11:44:13.049 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-361.el9.x86_64 2024-04-09T11:44:13.049 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.14.0-361.el9.x86_64 2024-04-09T11:44:13.049 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2024-04-09T11:44:15.668 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - AppStream 8.8 MB/s | 8.1 MB 00:00 2024-04-09T11:44:16.434 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - AppStream 11 MB/s | 8.1 MB 00:00 2024-04-09T11:44:17.419 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.5 MB 00:00 2024-04-09T11:44:18.343 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - BaseOS 4.7 MB/s | 2.5 MB 00:00 2024-04-09T11:44:20.692 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.0 MB 00:02 2024-04-09T11:44:23.719 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.0 MB 00:04 2024-04-09T11:44:25.746 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-09T11:44:26.201 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 19 MB 00:04 2024-04-09T11:44:29.990 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-09T11:44:30.252 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-04-09T11:44:31.677 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-04-09T11:44:32.028 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-09T11:44:33.863 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-09T11:44:33.945 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-09T11:44:39.112 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-09T11:44:39.139 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-09T11:44:41.333 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:44:41.333 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:44:41.333 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:44:41.333 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.334 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:44:41.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:44:41.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:44:41.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:44:41.338 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.340 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.341 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:44:41.342 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.342 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.342 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.342 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.475 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:44:41.475 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:44:41.475 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:44:41.475 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.475 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:44:41.475 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.475 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:44:41.475 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:44:41.476 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.477 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:44:41.477 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.477 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:44:41.477 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.477 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:44:41.477 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.477 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:44:41.477 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.477 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:44:41.477 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.477 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:44:41.478 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:44:41.479 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:44:41.480 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.481 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:44:41.483 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.484 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.484 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.484 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:44:41.761 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-09T11:44:41.761 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-09T11:44:41.861 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:44:41.870 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:44:41.870 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-04-09T11:44:41.870 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:44:41.870 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:44:41.870 INFO:teuthology.orchestra.run.smithi173.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-09T11:44:41.870 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-04-09T11:44:41.870 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-09T11:44:41.870 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-09T11:44:41.870 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-09T11:44:41.870 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:44:41.871 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:44:41.871 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:44:41.871 INFO:teuthology.orchestra.run.smithi173.stdout:Install 4 Packages 2024-04-09T11:44:41.871 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:44:41.871 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 77 M 2024-04-09T11:44:41.871 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 123 M 2024-04-09T11:44:41.871 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:44:41.939 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-09T11:44:41.939 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-09T11:44:42.060 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:44:42.075 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:44:42.075 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-04-09T11:44:42.075 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:44:42.075 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:44:42.075 INFO:teuthology.orchestra.run.smithi029.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-09T11:44:42.075 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-09T11:44:42.075 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-09T11:44:42.075 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-09T11:44:42.075 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-09T11:44:42.076 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:44:42.076 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:44:42.076 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:44:42.076 INFO:teuthology.orchestra.run.smithi029.stdout:Install 4 Packages 2024-04-09T11:44:42.076 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:44:42.076 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 77 M 2024-04-09T11:44:42.076 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 123 M 2024-04-09T11:44:42.077 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:44:42.346 INFO:teuthology.orchestra.run.smithi173.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 486 kB/s | 214 kB 00:00 2024-04-09T11:44:43.069 INFO:teuthology.orchestra.run.smithi029.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 296 kB/s | 214 kB 00:00 2024-04-09T11:44:45.613 INFO:teuthology.orchestra.run.smithi173.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 4.1 MB/s | 15 MB 00:03 2024-04-09T11:44:46.294 INFO:teuthology.orchestra.run.smithi029.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 3.8 MB/s | 15 MB 00:03 2024-04-09T11:44:47.854 INFO:teuthology.orchestra.run.smithi173.stdout:(3/4): kernel-modules-core-5.14.0-435.el9.x86_6 5.0 MB/s | 28 MB 00:05 2024-04-09T11:44:48.563 INFO:teuthology.orchestra.run.smithi173.stdout:(4/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 5.0 MB/s | 34 MB 00:06 2024-04-09T11:44:48.564 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:44:48.564 INFO:teuthology.orchestra.run.smithi173.stdout:Total 11 MB/s | 77 MB 00:06 2024-04-09T11:44:49.236 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:44:49.591 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:44:49.592 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:44:50.052 INFO:teuthology.orchestra.run.smithi029.stdout:(3/4): kernel-modules-core-5.14.0-435.el9.x86_6 4.0 MB/s | 28 MB 00:06 2024-04-09T11:44:50.602 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:44:50.602 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:44:53.060 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:44:53.748 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-09T11:44:53.872 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-09T11:44:56.670 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-09T11:44:56.810 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-09T11:44:59.036 INFO:teuthology.orchestra.run.smithi029.stdout:(4/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 2.0 MB/s | 34 MB 00:16 2024-04-09T11:44:59.036 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:44:59.036 INFO:teuthology.orchestra.run.smithi029.stdout:Total 4.5 MB/s | 77 MB 00:16 2024-04-09T11:44:59.735 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:45:00.198 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:45:00.199 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:45:01.242 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:45:01.242 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:45:01.600 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-09T11:45:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:03.850 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:45:04.558 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-09T11:45:04.666 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-09T11:45:06.432 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:07.553 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-09T11:45:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-09T11:45:12.835 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-09T11:45:12.883 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:17.983 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:35.517 INFO:teuthology.orchestra.run.smithi173.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-09T11:45:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:45:35.562 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:35.914 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:35.915 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-09T11:45:35.915 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-09T11:45:35.915 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-09T11:45:36.364 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:36.364 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:45:36.364 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:45:36.364 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-09T11:45:36.364 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-09T11:45:36.365 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-09T11:45:36.365 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-09T11:45:36.365 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:45:36.365 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:45:36.719 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel | sort -rV | head -n 1 2024-04-09T11:45:36.824 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-09T11:45:36.825 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-09T11:45:36.825 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-09T11:45:36.826 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-09T11:45:36.826 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-09T11:45:36.826 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-09T11:45:36.826 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=None, version=distro) 2024-04-09T11:45:36.826 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel | sort -rV | head -n 1 2024-04-09T11:45:36.907 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-09T11:45:36.907 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-09T11:45:36.907 DEBUG:teuthology.orchestra.run.smithi173:> sudo rpm -qi grub2-tools 2024-04-09T11:45:36.950 INFO:teuthology.orchestra.run.smithi173.stdout:Name : grub2-tools 2024-04-09T11:45:36.950 INFO:teuthology.orchestra.run.smithi173.stdout:Epoch : 1 2024-04-09T11:45:36.950 INFO:teuthology.orchestra.run.smithi173.stdout:Version : 2.06 2024-04-09T11:45:36.950 INFO:teuthology.orchestra.run.smithi173.stdout:Release : 68.el9 2024-04-09T11:45:36.950 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: x86_64 2024-04-09T11:45:36.950 INFO:teuthology.orchestra.run.smithi173.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-09T11:45:36.950 INFO:teuthology.orchestra.run.smithi173.stdout:Group : Unspecified 2024-04-09T11:45:36.950 INFO:teuthology.orchestra.run.smithi173.stdout:Size : 8264254 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:License : GPLv3+ 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:Packager : builder@centos.org 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:Vendor : CentOS 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:Summary : Support tools for GRUB. 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:Description : 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-09T11:45:36.951 INFO:teuthology.orchestra.run.smithi173.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-09T11:45:36.952 INFO:teuthology.orchestra.run.smithi173.stdout:hardware devices. 2024-04-09T11:45:36.952 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:45:36.952 INFO:teuthology.orchestra.run.smithi173.stdout:This subpackage provides tools for support of all platforms. 2024-04-09T11:45:36.953 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-09T11:45:36.953 INFO:teuthology.task.kernel:Updating grub on smithi173 to boot 5.14.0-435.el9.x86_64 2024-04-09T11:45:36.953 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-09T11:45:37.573 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2024-04-09T11:45:38.917 INFO:teuthology.orchestra.run.smithi173.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-09T11:45:38.951 INFO:teuthology.orchestra.run.smithi173.stderr:done 2024-04-09T11:45:38.954 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-04-09T11:45:38.968 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.5h9nNlsNPl 2024-04-09T11:45:38.969 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5h9nNlsNPl 2024-04-09T11:45:39.038 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.5h9nNlsNPl 2024-04-09T11:45:39.181 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.5h9nNlsNPl is 6KB 2024-04-09T11:45:39.232 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.5h9nNlsNPl 2024-04-09T11:45:39.246 DEBUG:teuthology.orchestra.run.smithi173:> sudo /bin/ls /boot/loader/entries || true 2024-04-09T11:45:39.320 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-09T11:45:39.320 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-09T11:45:39.320 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-09T11:45:39.320 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-09T11:45:39.321 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-09T11:45:39.471 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2024-04-09T11:45:51.262 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:51.263 INFO:teuthology.orchestra.run.smithi029.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-09T11:45:51.263 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:45:51.309 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-09T11:45:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-09T11:45:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-09T11:45:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-09T11:45:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:45:52.220 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:45:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-09T11:45:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-09T11:45:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-09T11:45:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-09T11:45:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:45:52.220 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:45:52.664 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-04-09T11:45:52.813 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-09T11:45:52.814 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-09T11:45:52.814 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-09T11:45:52.814 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-09T11:45:52.814 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-09T11:45:52.814 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-09T11:45:52.814 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-04-09T11:45:52.815 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-04-09T11:45:52.899 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-09T11:45:52.899 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-09T11:45:52.899 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2024-04-09T11:45:52.944 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2024-04-09T11:45:52.944 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2024-04-09T11:45:52.944 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.06 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 68.el9 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:Group : Unspecified 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 8264254 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : builder@centos.org 2024-04-09T11:45:52.945 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : CentOS 2024-04-09T11:45:52.946 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-09T11:45:52.946 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2024-04-09T11:45:52.946 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2024-04-09T11:45:52.946 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:45:52.946 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-09T11:45:52.946 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-09T11:45:52.946 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-09T11:45:52.946 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2024-04-09T11:45:52.946 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:45:52.946 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2024-04-09T11:45:52.947 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-09T11:45:52.947 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 5.14.0-435.el9.x86_64 2024-04-09T11:45:52.947 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-09T11:45:53.705 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-04-09T11:45:55.391 INFO:teuthology.orchestra.run.smithi029.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-09T11:45:55.416 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-04-09T11:45:55.419 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-09T11:45:55.434 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.NiIsEGe9Nv 2024-04-09T11:45:55.434 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NiIsEGe9Nv 2024-04-09T11:45:55.506 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.NiIsEGe9Nv 2024-04-09T11:45:55.655 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.NiIsEGe9Nv is 6KB 2024-04-09T11:45:55.704 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.NiIsEGe9Nv 2024-04-09T11:45:55.719 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2024-04-09T11:45:55.790 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-09T11:45:55.790 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-09T11:45:55.790 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-09T11:45:55.790 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-09T11:45:55.791 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-09T11:45:55.955 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-04-09T11:46:09.487 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-09T11:46:09.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-09T11:46:09.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T11:46:25.970 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-09T11:46:25.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-09T11:46:25.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T11:46:44.130 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-09T11:46:53.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-09T11:46:53.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T11:47:11.519 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-09T11:47:23.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-09T11:47:23.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T11:47:23.959 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-04-09T11:47:24.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-09T11:47:24.456 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-435.el9.x86_64"... 2024-04-09T11:47:24.456 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-04-09T11:47:24.470 INFO:teuthology.orchestra.run.smithi173.stdout:5.14.0-435.el9.x86_64 2024-04-09T11:47:24.470 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-09T11:47:24.470 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-09T11:47:24.470 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-09T11:47:25.471 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-09T11:47:25.471 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-09T11:47:25.666 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2024-04-09T11:47:25.700 DEBUG:teuthology.parallel:result is None 2024-04-09T11:47:25.973 DEBUG:teuthology.orchestra.remote:timed out 2024-04-09T11:47:34.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-09T11:47:34.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T11:47:38.442 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-09T11:47:39.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-09T11:47:39.382 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-435.el9.x86_64"... 2024-04-09T11:47:39.382 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-09T11:47:39.398 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-435.el9.x86_64 2024-04-09T11:47:39.398 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-09T11:47:39.399 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-09T11:47:39.399 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-09T11:47:40.400 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-09T11:47:40.400 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-09T11:47:40.701 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2024-04-09T11:47:40.751 DEBUG:teuthology.parallel:result is None 2024-04-09T11:47:40.752 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-09T11:47:40.759 INFO:teuthology.task.internal:Creating test directory... 2024-04-09T11:47:40.760 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-09T11:47:40.762 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-09T11:47:40.782 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-09T11:47:40.789 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-09T11:47:40.796 INFO:teuthology.task.internal:Creating archive directory... 2024-04-09T11:47:40.796 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-09T11:47:40.818 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-09T11:47:40.856 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-09T11:47:40.863 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-09T11:47:40.863 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-09T11:47:40.884 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-09T11:47:40.930 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-09T11:47:40.934 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-09T11:47:40.945 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-09T11:47:40.947 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-09T11:47:40.948 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-09T11:47:40.955 INFO:teuthology.task.internal:Configuring sudo... 2024-04-09T11:47:40.955 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-09T11:47:40.957 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-09T11:47:41.016 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-09T11:47:41.025 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-09T11:47:41.025 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-09T11:47:41.027 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-09T11:47:41.072 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-09T11:47:41.122 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-09T11:47:41.170 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-09T11:47:41.248 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-09T11:47:41.294 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T11:47:41.294 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-09T11:47:41.371 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-09T11:47:41.415 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-09T11:47:41.465 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-09T11:47:41.550 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-09T11:47:41.593 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T11:47:41.594 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-09T11:47:41.661 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-04-09T11:47:41.664 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-04-09T11:47:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-09T11:47:41.751 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-09T11:47:42.259 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-09T11:47:42.267 INFO:teuthology.task.internal:Starting timer... 2024-04-09T11:47:42.267 INFO:teuthology.run_tasks:Running task pcp... 2024-04-09T11:47:42.280 INFO:teuthology.run_tasks:Running task selinux... 2024-04-09T11:47:42.289 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2024-04-09T11:47:42.392 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2024-04-09T11:47:42.393 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2024-04-09T11:47:42.442 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2024-04-09T11:47:42.444 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-09T11:47:42.444 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2024-04-09T11:47:42.469 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2024-04-09T11:47:42.469 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2024-04-09T11:47:42.491 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2024-04-09T11:47:42.491 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2024-04-09T11:47:42.493 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-09T11:47:42.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-09T11:47:42.541 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-09T11:47:42.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-09T11:47:42.572 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-09T11:47:42.572 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2024-04-09T11:47:42.638 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2024-04-09T11:47:42.676 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-09T11:47:42.686 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-09T11:47:42.703 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-09T11:47:42.705 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-09T11:52:19.348 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-04-09T11:52:19.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-09T11:52:19.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T11:52:19.443 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-09T11:52:19.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-09T11:52:19.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-09T11:52:19.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T11:52:19.611 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-04-09T11:52:19.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-09T11:52:19.693 INFO:teuthology.run_tasks:Running task clock... 2024-04-09T11:52:19.707 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-09T11:52:19.708 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-09T11:52:19.708 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-09T11:52:19.711 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-09T11:52:19.711 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-09T11:52:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-09T11:52:19.756 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-09T11:52:19.764 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-09T11:52:19.781 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-09T11:52:19.786 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2024-04-09T11:52:19.800 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2024-04-09T11:52:19.811 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2024-04-09T11:52:19.816 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-09T11:52:19.824 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2024-04-09T11:52:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-09T11:52:19.841 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-09T11:52:19.857 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-09T11:52:19.899 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-04-09T11:52:19.903 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-09T11:52:19.903 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-04-09T11:52:19.903 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-09T11:52:19.903 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-09T11:52:19.904 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-09T11:52:19.904 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-09T11:52:19.909 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-04-09T11:52:19.912 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-09T11:52:19.912 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-04-09T11:52:19.912 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-09T11:52:19.913 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-09T11:52:19.913 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-09T11:52:19.913 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-09T11:52:19.914 INFO:teuthology.run_tasks:Running task install... 2024-04-09T11:52:19.921 DEBUG:teuthology.task.install:project ceph 2024-04-09T11:52:19.921 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'd540ebaca6b131a1dd560e7f69e024b133bbaa42'}} 2024-04-09T11:52:19.922 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': 'd540ebaca6b131a1dd560e7f69e024b133bbaa42'} 2024-04-09T11:52:19.922 INFO:teuthology.task.install:Using flavor: default 2024-04-09T11:52:19.927 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-04-09T11:52:19.928 INFO:teuthology.task.install:extra packages: [] 2024-04-09T11:52:19.928 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd540ebaca6b131a1dd560e7f69e024b133bbaa42', 'tag': None, 'wait_for_package': False} 2024-04-09T11:52:19.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d540ebaca6b131a1dd560e7f69e024b133bbaa42 2024-04-09T11:52:19.931 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd540ebaca6b131a1dd560e7f69e024b133bbaa42', 'tag': None, 'wait_for_package': False} 2024-04-09T11:52:19.931 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d540ebaca6b131a1dd560e7f69e024b133bbaa42 2024-04-09T11:52:20.095 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/d540ebaca6b131a1dd560e7f69e024b133bbaa42/centos/9/flavors/default/ 2024-04-09T11:52:20.095 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1187.gd540ebac 2024-04-09T11:52:20.276 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/d540ebaca6b131a1dd560e7f69e024b133bbaa42/centos/9/flavors/default/ 2024-04-09T11:52:20.276 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1187.gd540ebac 2024-04-09T11:52:20.394 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/d540ebaca6b131a1dd560e7f69e024b133bbaa42/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/d540ebaca6b131a1dd560e7f69e024b133bbaa42/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/d540ebaca6b131a1dd560e7f69e024b133bbaa42/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-09T11:52:20.394 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T11:52:20.395 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-09T11:52:20.400 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/d540ebaca6b131a1dd560e7f69e024b133bbaa42/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/d540ebaca6b131a1dd560e7f69e024b133bbaa42/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/d540ebaca6b131a1dd560e7f69e024b133bbaa42/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-09T11:52:20.400 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T11:52:20.401 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-09T11:52:20.423 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2024-04-09T11:52:20.423 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d540ebaca6b131a1dd560e7f69e024b133bbaa42/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-09T11:52:20.429 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2024-04-09T11:52:20.429 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d540ebaca6b131a1dd560e7f69e024b133bbaa42/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-09T11:52:20.490 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-09T11:52:20.498 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-09T11:52:20.570 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-09T11:52:20.577 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-09T11:52:20.636 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2024-04-09T11:52:20.638 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2024-04-09T11:52:20.643 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2024-04-09T11:52:20.645 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2024-04-09T11:52:20.881 INFO:teuthology.orchestra.run.smithi029.stdout:74 files removed 2024-04-09T11:52:20.889 INFO:teuthology.orchestra.run.smithi173.stdout:74 files removed 2024-04-09T11:52:20.909 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw 2024-04-09T11:52:20.918 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw 2024-04-09T11:52:21.619 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 192 kB/s | 77 kB 00:00 2024-04-09T11:52:21.684 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 166 kB/s | 77 kB 00:00 2024-04-09T11:52:21.995 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-04-09T11:52:22.052 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-04-09T11:52:22.371 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-04-09T11:52:22.437 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 5.5 kB/s | 1.9 kB 00:00 2024-04-09T11:52:22.882 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - AppStream 17 MB/s | 8.1 MB 00:00 2024-04-09T11:52:23.100 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - AppStream 13 MB/s | 8.1 MB 00:00 2024-04-09T11:52:24.540 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - BaseOS 8.0 MB/s | 2.5 MB 00:00 2024-04-09T11:52:24.826 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.5 MB 00:00 2024-04-09T11:52:25.948 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.0 MB 00:00 2024-04-09T11:52:25.985 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-09T11:52:30.082 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-04-09T11:52:34.667 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.2 MB 00:00 2024-04-09T11:52:36.259 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 16 kB 00:00 2024-04-09T11:52:37.394 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:00 2024-04-09T11:52:42.402 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-09T11:52:43.622 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-04-09T11:52:44.977 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:52:44.977 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:52:44.977 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:52:44.977 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.977 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:52:44.978 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.978 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:52:44.978 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.978 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:52:44.978 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.978 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:52:44.978 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.978 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:52:44.978 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.978 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:52:44.978 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.979 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:52:44.980 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:52:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:52:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:52:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:52:45.490 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:52:45.504 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:52:45.504 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-04-09T11:52:45.504 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:52:45.504 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:52:45.504 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 7.7 M 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 3.3 M 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 3.0 M 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 5.1 M 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 18 M 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 25 k 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-09T11:52:45.505 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 709 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 474 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 4.5 M 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 45 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 129 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 161 k 2024-04-09T11:52:45.506 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-09T11:52:45.507 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 320 k 2024-04-09T11:52:45.507 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 299 k 2024-04-09T11:52:45.507 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 99 k 2024-04-09T11:52:45.507 INFO:teuthology.orchestra.run.smithi173.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-09T11:52:45.507 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-09T11:52:45.507 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:52:45.507 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:52:45.507 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:52:45.507 INFO:teuthology.orchestra.run.smithi173.stdout:Install 28 Packages 2024-04-09T11:52:45.507 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 2 Packages 2024-04-09T11:52:45.507 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:52:45.508 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 53 M 2024-04-09T11:52:45.508 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:52:46.320 INFO:teuthology.orchestra.run.smithi173.stdout:(1/30): ceph-base-18.2.2-1187.gd540ebac.el9.x86 8.5 MB/s | 5.1 MB 00:00 2024-04-09T11:52:46.371 INFO:teuthology.orchestra.run.smithi173.stdout:(2/30): ceph-selinux-18.2.2-1187.gd540ebac.el9. 505 kB/s | 25 kB 00:00 2024-04-09T11:52:46.529 INFO:teuthology.orchestra.run.smithi173.stdout:(3/30): ceph-radosgw-18.2.2-1187.gd540ebac.el9. 9.5 MB/s | 7.7 MB 00:00 2024-04-09T11:52:46.563 INFO:teuthology.orchestra.run.smithi173.stdout:(4/30): libcephfs2-18.2.2-1187.gd540ebac.el9.x8 3.6 MB/s | 709 kB 00:00 2024-04-09T11:52:46.588 INFO:teuthology.orchestra.run.smithi173.stdout:(5/30): libradosstriper1-18.2.2-1187.gd540ebac. 7.9 MB/s | 474 kB 00:00 2024-04-09T11:52:46.630 INFO:teuthology.orchestra.run.smithi173.stdout:(6/30): python3-ceph-argparse-18.2.2-1187.gd540 1.1 MB/s | 45 kB 00:00 2024-04-09T11:52:46.681 INFO:teuthology.orchestra.run.smithi173.stdout:(7/30): python3-ceph-common-18.2.2-1187.gd540eb 2.5 MB/s | 129 kB 00:00 2024-04-09T11:52:46.748 INFO:teuthology.orchestra.run.smithi173.stdout:(8/30): python3-cephfs-18.2.2-1187.gd540ebac.el 2.4 MB/s | 161 kB 00:00 2024-04-09T11:52:46.839 INFO:teuthology.orchestra.run.smithi173.stdout:(9/30): librgw2-18.2.2-1187.gd540ebac.el9.x86_6 16 MB/s | 4.5 MB 00:00 2024-04-09T11:52:46.865 INFO:teuthology.orchestra.run.smithi173.stdout:(10/30): python3-rados-18.2.2-1187.gd540ebac.el 2.7 MB/s | 320 kB 00:00 2024-04-09T11:52:46.890 INFO:teuthology.orchestra.run.smithi173.stdout:(11/30): python3-rbd-18.2.2-1187.gd540ebac.el9. 5.8 MB/s | 299 kB 00:00 2024-04-09T11:52:46.915 INFO:teuthology.orchestra.run.smithi173.stdout:(12/30): python3-rgw-18.2.2-1187.gd540ebac.el9. 1.9 MB/s | 99 kB 00:00 2024-04-09T11:52:47.207 INFO:teuthology.orchestra.run.smithi173.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 337 kB/s | 107 kB 00:00 2024-04-09T11:52:47.233 INFO:teuthology.orchestra.run.smithi173.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 505 kB/s | 160 kB 00:00 2024-04-09T11:52:47.583 INFO:teuthology.orchestra.run.smithi173.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 120 kB/s | 45 kB 00:00 2024-04-09T11:52:47.757 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-04-09T11:52:47.950 INFO:teuthology.orchestra.run.smithi173.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 797 kB/s | 292 kB 00:00 2024-04-09T11:52:48.009 INFO:teuthology.orchestra.run.smithi173.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 724 kB/s | 42 kB 00:00 2024-04-09T11:52:48.042 INFO:teuthology.orchestra.run.smithi173.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 819 kB/s | 662 kB 00:00 2024-04-09T11:52:48.234 INFO:teuthology.orchestra.run.smithi173.stdout:(19/30): fmt-8.1.1-5.el9.x86_64.rpm 492 kB/s | 111 kB 00:00 2024-04-09T11:52:48.301 INFO:teuthology.orchestra.run.smithi173.stdout:(20/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.2 MB/s | 309 kB 00:00 2024-04-09T11:52:48.368 INFO:teuthology.orchestra.run.smithi173.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-04-09T11:52:48.443 INFO:teuthology.orchestra.run.smithi173.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 649 kB/s | 49 kB 00:00 2024-04-09T11:52:48.552 INFO:teuthology.orchestra.run.smithi173.stdout:(23/30): libunwind-1.6.2-1.el9.x86_64.rpm 621 kB/s | 67 kB 00:00 2024-04-09T11:52:48.669 INFO:teuthology.orchestra.run.smithi173.stdout:(24/30): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-09T11:52:48.711 INFO:teuthology.orchestra.run.smithi173.stdout:(25/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.1 MB/s | 838 kB 00:00 2024-04-09T11:52:48.736 INFO:teuthology.orchestra.run.smithi173.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-09T11:52:48.829 INFO:teuthology.orchestra.run.smithi173.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-09T11:52:49.062 INFO:teuthology.orchestra.run.smithi173.stdout:(28/30): librados2-18.2.2-1187.gd540ebac.el9.x8 10 MB/s | 3.3 MB 00:00 2024-04-09T11:52:49.163 INFO:teuthology.orchestra.run.smithi173.stdout:(29/30): librbd1-18.2.2-1187.gd540ebac.el9.x86_ 9.0 MB/s | 3.0 MB 00:00 2024-04-09T11:52:49.292 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 16 kB 00:00 2024-04-09T11:52:51.558 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 21 MB 00:02 2024-04-09T11:52:56.029 INFO:teuthology.orchestra.run.smithi173.stdout:(30/30): ceph-common-18.2.2-1187.gd540ebac.el9. 1.8 MB/s | 18 MB 00:10 2024-04-09T11:52:56.032 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:52:56.032 INFO:teuthology.orchestra.run.smithi173.stdout:Total 5.0 MB/s | 53 MB 00:10 2024-04-09T11:52:56.103 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:52:56.138 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:52:56.138 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:52:56.607 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:52:56.607 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:52:56.774 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-09T11:52:58.115 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:52:58.198 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-04-09T11:52:58.234 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-04-09T11:52:58.285 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-04-09T11:52:58.602 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-04-09T11:52:58.658 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:18.2.2-1187.gd540ebac.el9.x86_64 5/32 2024-04-09T11:52:58.741 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:18.2.2-1187.gd540ebac.el9.x86_64 5/32 2024-04-09T11:52:58.825 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:18.2.2-1187.gd540ebac.el9.x86_64 6/32 2024-04-09T11:52:58.851 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:18.2.2-1187.gd540ebac.el9.x86_64 7/32 2024-04-09T11:52:58.906 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:18.2.2-1187.gd540ebac.el9.x86_64 7/32 2024-04-09T11:52:58.934 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-04-09T11:52:58.978 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:18.2.2-1187.gd540ebac.el9. 9/32 2024-04-09T11:52:59.044 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:18.2.2-1187.gd540ebac.el9.x86_64 10/32 2024-04-09T11:52:59.070 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:18.2.2-1187.gd540ebac.el9.x86_6 11/32 2024-04-09T11:52:59.119 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1187.gd540ebac.el9.x86_6 11/32 2024-04-09T11:52:59.226 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-04-09T11:52:59.270 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-04-09T11:52:59.310 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-04-09T11:52:59.351 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-04-09T11:52:59.378 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-04-09T11:52:59.414 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-04-09T11:52:59.443 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:52:59.443 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:52:59.443 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:52:59.443 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.443 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:52:59.443 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.443 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:52:59.443 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.443 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:52:59.443 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.443 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.444 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:52:59.445 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:52:59.446 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.447 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:52:59.448 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.449 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.450 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.450 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.450 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.450 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:52:59.450 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.450 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.450 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.450 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.450 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:52:59.450 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.450 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.451 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:52:59.452 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.452 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.452 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.452 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.452 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:52:59.452 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.452 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.452 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.452 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:52:59.455 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-04-09T11:52:59.752 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-04-09T11:52:59.777 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:18.2.2-1187.gd540ebac.el9.x86_64 20/32 2024-04-09T11:52:59.850 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:18.2.2-1187.gd540ebac.el9.x86_64 20/32 2024-04-09T11:52:59.907 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:18.2.2-1187.gd540ebac.el9.x86_64 21/32 2024-04-09T11:52:59.943 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-04-09T11:53:00.034 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:53:00.058 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:53:00.058 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-09T11:53:00.058 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 7.7 M 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 3.3 M 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 3.0 M 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 5.1 M 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 18 M 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 25 k 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-09T11:53:00.059 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 709 k 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 474 k 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 4.5 M 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 45 k 2024-04-09T11:53:00.060 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 129 k 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 161 k 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 320 k 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 299 k 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 99 k 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout:Install 28 Packages 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 2 Packages 2024-04-09T11:53:00.061 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:00.062 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 53 M 2024-04-09T11:53:00.062 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:53:00.334 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-04-09T11:53:00.363 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:18.2.2-1187.gd540ebac.el9.x86_64 24/32 2024-04-09T11:53:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:18.2.2-1187.gd540ebac.el9.x86_64 24/32 2024-04-09T11:53:00.493 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:18.2.2-1187.gd540ebac.el9.x86_64 25/32 2024-04-09T11:53:00.524 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:18.2.2-1187.gd540ebac.el9.x8 26/32 2024-04-09T11:53:02.226 INFO:teuthology.orchestra.run.smithi029.stdout:(1/30): ceph-base-18.2.2-1187.gd540ebac.el9.x86 2.5 MB/s | 5.1 MB 00:02 2024-04-09T11:53:02.278 INFO:teuthology.orchestra.run.smithi029.stdout:(2/30): ceph-selinux-18.2.2-1187.gd540ebac.el9. 503 kB/s | 25 kB 00:00 2024-04-09T11:53:02.586 INFO:teuthology.orchestra.run.smithi029.stdout:(3/30): libcephfs2-18.2.2-1187.gd540ebac.el9.x8 2.2 MB/s | 709 kB 00:00 2024-04-09T11:53:02.586 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 27/32 2024-04-09T11:53:02.629 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 27/32 2024-04-09T11:53:02.803 INFO:teuthology.orchestra.run.smithi029.stdout:(4/30): libradosstriper1-18.2.2-1187.gd540ebac. 2.1 MB/s | 474 kB 00:00 2024-04-09T11:53:03.183 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 27/32 2024-04-09T11:53:03.224 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:18.2.2-1187.gd540ebac.el9.x86_64 28/32 2024-04-09T11:53:03.509 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:18.2.2-1187.gd540ebac.el9.x86_64 28/32 2024-04-09T11:53:03.509 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-09T11:53:03.509 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-09T11:53:03.510 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:03.551 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:18.2.2-1187.gd540ebac.el9.x86_64 29/32 2024-04-09T11:53:04.512 INFO:teuthology.orchestra.run.smithi029.stdout:(5/30): ceph-radosgw-18.2.2-1187.gd540ebac.el9. 1.8 MB/s | 7.7 MB 00:04 2024-04-09T11:53:04.613 INFO:teuthology.orchestra.run.smithi029.stdout:(6/30): librgw2-18.2.2-1187.gd540ebac.el9.x86_6 2.5 MB/s | 4.5 MB 00:01 2024-04-09T11:53:04.639 INFO:teuthology.orchestra.run.smithi029.stdout:(7/30): python3-ceph-argparse-18.2.2-1187.gd540 354 kB/s | 45 kB 00:00 2024-04-09T11:53:04.742 INFO:teuthology.orchestra.run.smithi029.stdout:(8/30): python3-cephfs-18.2.2-1187.gd540ebac.el 1.6 MB/s | 161 kB 00:00 2024-04-09T11:53:04.782 INFO:teuthology.orchestra.run.smithi029.stdout:(9/30): python3-ceph-common-18.2.2-1187.gd540eb 769 kB/s | 129 kB 00:00 2024-04-09T11:53:04.899 INFO:teuthology.orchestra.run.smithi029.stdout:(10/30): python3-rados-18.2.2-1187.gd540ebac.el 2.0 MB/s | 320 kB 00:00 2024-04-09T11:53:04.950 INFO:teuthology.orchestra.run.smithi029.stdout:(11/30): python3-rbd-18.2.2-1187.gd540ebac.el9. 1.7 MB/s | 299 kB 00:00 2024-04-09T11:53:04.984 INFO:teuthology.orchestra.run.smithi029.stdout:(12/30): python3-rgw-18.2.2-1187.gd540ebac.el9. 1.2 MB/s | 99 kB 00:00 2024-04-09T11:53:05.393 INFO:teuthology.orchestra.run.smithi029.stdout:(13/30): ceph-common-18.2.2-1187.gd540ebac.el9. 3.5 MB/s | 18 MB 00:05 2024-04-09T11:53:05.460 INFO:teuthology.orchestra.run.smithi029.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 210 kB/s | 107 kB 00:00 2024-04-09T11:53:05.494 INFO:teuthology.orchestra.run.smithi029.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 314 kB/s | 160 kB 00:00 2024-04-09T11:53:05.586 INFO:teuthology.orchestra.run.smithi029.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 235 kB/s | 45 kB 00:00 2024-04-09T11:53:05.645 INFO:teuthology.orchestra.run.smithi029.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 724 kB/s | 42 kB 00:00 2024-04-09T11:53:05.754 INFO:teuthology.orchestra.run.smithi029.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.1 MB/s | 292 kB 00:00 2024-04-09T11:53:05.838 INFO:teuthology.orchestra.run.smithi029.stdout:(19/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.7 MB/s | 309 kB 00:00 2024-04-09T11:53:05.863 INFO:teuthology.orchestra.run.smithi029.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 508 kB/s | 111 kB 00:00 2024-04-09T11:53:05.915 INFO:teuthology.orchestra.run.smithi029.stdout:(21/30): librdkafka-1.6.1-102.el9.x86_64.rpm 1.4 MB/s | 662 kB 00:00 2024-04-09T11:53:06.041 INFO:teuthology.orchestra.run.smithi029.stdout:(22/30): libarrow-9.0.0-10.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-04-09T11:53:06.066 INFO:teuthology.orchestra.run.smithi029.stdout:(23/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 129 kB/s | 26 kB 00:00 2024-04-09T11:53:06.092 INFO:teuthology.orchestra.run.smithi029.stdout:(24/30): liboath-2.6.7-2.el9.x86_64.rpm 280 kB/s | 49 kB 00:00 2024-04-09T11:53:06.117 INFO:teuthology.orchestra.run.smithi029.stdout:(25/30): libunwind-1.6.2-1.el9.x86_64.rpm 888 kB/s | 67 kB 00:00 2024-04-09T11:53:06.151 INFO:teuthology.orchestra.run.smithi029.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-04-09T11:53:06.194 INFO:teuthology.orchestra.run.smithi029.stdout:(27/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.1 MB/s | 838 kB 00:00 2024-04-09T11:53:06.244 INFO:teuthology.orchestra.run.smithi029.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-09T11:53:06.527 INFO:teuthology.orchestra.run.smithi029.stdout:(29/30): librbd1-18.2.2-1187.gd540ebac.el9.x86_ 9.1 MB/s | 3.0 MB 00:00 2024-04-09T11:53:06.761 INFO:teuthology.orchestra.run.smithi029.stdout:(30/30): librados2-18.2.2-1187.gd540ebac.el9.x8 5.4 MB/s | 3.3 MB 00:00 2024-04-09T11:53:06.765 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:53:06.765 INFO:teuthology.orchestra.run.smithi029.stdout:Total 7.9 MB/s | 53 MB 00:06 2024-04-09T11:53:06.835 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:53:06.874 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:53:06.874 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:53:07.371 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:53:07.371 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:53:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:53:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-04-09T11:53:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-04-09T11:53:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-04-09T11:53:09.399 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-04-09T11:53:09.471 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:18.2.2-1187.gd540ebac.el9.x86_64 5/32 2024-04-09T11:53:09.563 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:18.2.2-1187.gd540ebac.el9.x86_64 5/32 2024-04-09T11:53:09.659 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:18.2.2-1187.gd540ebac.el9.x86_64 6/32 2024-04-09T11:53:09.699 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:18.2.2-1187.gd540ebac.el9.x86_64 7/32 2024-04-09T11:53:09.763 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:18.2.2-1187.gd540ebac.el9.x86_64 7/32 2024-04-09T11:53:09.801 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-04-09T11:53:09.845 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:18.2.2-1187.gd540ebac.el9. 9/32 2024-04-09T11:53:09.921 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:18.2.2-1187.gd540ebac.el9.x86_64 10/32 2024-04-09T11:53:09.955 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:18.2.2-1187.gd540ebac.el9.x86_6 11/32 2024-04-09T11:53:10.020 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1187.gd540ebac.el9.x86_6 11/32 2024-04-09T11:53:10.131 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-04-09T11:53:10.170 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-04-09T11:53:10.221 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-04-09T11:53:10.265 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-04-09T11:53:10.301 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-04-09T11:53:10.337 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-04-09T11:53:10.370 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-04-09T11:53:10.684 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-04-09T11:53:10.718 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:18.2.2-1187.gd540ebac.el9.x86_64 20/32 2024-04-09T11:53:10.801 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:18.2.2-1187.gd540ebac.el9.x86_64 20/32 2024-04-09T11:53:10.841 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:18.2.2-1187.gd540ebac.el9.x86_64 21/32 2024-04-09T11:53:10.887 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-04-09T11:53:11.309 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-04-09T11:53:11.349 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:18.2.2-1187.gd540ebac.el9.x86_64 24/32 2024-04-09T11:53:11.429 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:18.2.2-1187.gd540ebac.el9.x86_64 24/32 2024-04-09T11:53:11.516 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:18.2.2-1187.gd540ebac.el9.x86_64 25/32 2024-04-09T11:53:11.553 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:18.2.2-1187.gd540ebac.el9.x8 26/32 2024-04-09T11:53:12.983 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1187.gd540ebac.el9.x86_64 29/32 2024-04-09T11:53:12.983 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2024-04-09T11:53:12.983 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2024-04-09T11:53:12.983 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2024-04-09T11:53:12.983 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2024-04-09T11:53:12.983 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2024-04-09T11:53:12.983 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /root 2024-04-09T11:53:12.983 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2024-04-09T11:53:12.983 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:13.701 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 27/32 2024-04-09T11:53:13.751 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 27/32 2024-04-09T11:53:13.779 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:18.2.2-1187.gd540ebac.el9.x86_64 30/32 2024-04-09T11:53:13.803 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1187.gd540ebac.el9.x86_64 30/32 2024-04-09T11:53:13.804 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:53:13.804 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-09T11:53:13.804 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-09T11:53:13.804 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-09T11:53:13.804 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:13.806 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-09T11:53:13.881 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-09T11:53:13.881 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-09T11:53:14.303 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 27/32 2024-04-09T11:53:14.358 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:18.2.2-1187.gd540ebac.el9.x86_64 28/32 2024-04-09T11:53:14.436 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:18.2.2-1187.gd540ebac.el9.x86_64 28/32 2024-04-09T11:53:14.436 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-09T11:53:14.436 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-09T11:53:14.436 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:14.477 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:18.2.2-1187.gd540ebac.el9.x86_64 29/32 2024-04-09T11:53:14.948 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-09T11:53:14.948 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:18.2.2-1187.gd540ebac.el9.x86_64 1/32 2024-04-09T11:53:14.948 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 2/32 2024-04-09T11:53:14.948 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:18.2.2-1187.gd540ebac.el9.x86_64 3/32 2024-04-09T11:53:14.948 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:18.2.2-1187.gd540ebac.el9.x86_64 4/32 2024-04-09T11:53:14.948 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:18.2.2-1187.gd540ebac.el9.x86_64 5/32 2024-04-09T11:53:14.948 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:18.2.2-1187.gd540ebac.el9.x86_6 6/32 2024-04-09T11:53:14.948 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:18.2.2-1187.gd540ebac.el9.x86_64 7/32 2024-04-09T11:53:14.948 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1187.gd540ebac.el9. 8/32 2024-04-09T11:53:14.948 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:18.2.2-1187.gd540ebac.el9.x8 9/32 2024-04-09T11:53:14.948 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:18.2.2-1187.gd540ebac.el9.x86_64 10/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:18.2.2-1187.gd540ebac.el9.x86_64 11/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:18.2.2-1187.gd540ebac.el9.x86_64 12/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:18.2.2-1187.gd540ebac.el9.x86_64 13/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-04-09T11:53:14.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-04-09T11:53:14.950 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-04-09T11:53:14.950 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-04-09T11:53:14.950 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-04-09T11:53:14.950 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-04-09T11:53:14.950 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-04-09T11:53:14.951 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:18.2.2-1187.gd540ebac.el9.x86_64 29/32 2024-04-09T11:53:14.951 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-04-09T11:53:14.951 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:18.2.2-1187.gd540ebac.el9.x86_64 31/32 2024-04-09T11:53:15.983 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-04-09T11:53:15.983 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:15.983 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2024-04-09T11:53:15.983 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.984 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-09T11:53:15.985 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.986 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.986 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:15.986 INFO:teuthology.orchestra.run.smithi173.stdout: re2-1:20211101-3.el9.x86_64 2024-04-09T11:53:15.986 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-09T11:53:15.986 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:15.986 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:53:16.286 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-test 2024-04-09T11:53:16.883 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:34 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:53:17.171 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:53:17.171 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:53:17.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:53:17.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:53:17.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:53:17.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:53:17.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:53:17.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:53:17.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:53:17.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:53:17.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.180 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:53:17.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:53:17.239 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:53:17.239 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 40 M 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 166 k 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:17.240 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:53:17.241 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:17.241 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2024-04-09T11:53:17.241 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:17.241 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 41 M 2024-04-09T11:53:17.241 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 164 M 2024-04-09T11:53:17.241 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:53:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 523 kB/s | 187 kB 00:00 2024-04-09T11:53:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): libcephsqlite-18.2.2-1187.gd540ebac.el9. 356 kB/s | 166 kB 00:00 2024-04-09T11:53:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 968 kB/s | 218 kB 00:00 2024-04-09T11:53:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): socat-1.7.4.1-5.el9.x86_64.rpm 2.1 MB/s | 305 kB 00:00 2024-04-09T11:53:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-04-09T11:53:19.796 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): ceph-test-18.2.2-1187.gd540ebac.el9.x86_ 19 MB/s | 40 MB 00:02 2024-04-09T11:53:19.799 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:53:19.799 INFO:teuthology.orchestra.run.smithi173.stdout:Total 16 MB/s | 41 MB 00:02 2024-04-09T11:53:19.850 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:53:19.869 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:53:19.869 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:53:20.205 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:53:20.206 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:53:20.746 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:53:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-09T11:53:20.869 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-09T11:53:20.910 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-09T11:53:20.954 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-09T11:53:20.982 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:18.2.2-1187.gd540ebac.el9.x86_64 5/6 2024-04-09T11:53:24.693 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1187.gd540ebac.el9.x86_64 5/6 2024-04-09T11:53:24.764 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:18.2.2-1187.gd540ebac.el9.x86_64 6/6 2024-04-09T11:53:26.407 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1187.gd540ebac.el9.x86_64 29/32 2024-04-09T11:53:26.407 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2024-04-09T11:53:26.407 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2024-04-09T11:53:26.407 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2024-04-09T11:53:26.407 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2024-04-09T11:53:26.407 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2024-04-09T11:53:26.407 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /root 2024-04-09T11:53:26.407 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2024-04-09T11:53:26.407 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:26.875 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-test-2:18.2.2-1187.gd540ebac.el9.x86_64 6/6 2024-04-09T11:53:26.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:18.2.2-1187.gd540ebac.el9.x86_64 1/6 2024-04-09T11:53:26.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:18.2.2-1187.gd540ebac.el9.x86_64 2/6 2024-04-09T11:53:26.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-04-09T11:53:26.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-04-09T11:53:26.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-04-09T11:53:27.192 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:18.2.2-1187.gd540ebac.el9.x86_64 30/32 2024-04-09T11:53:27.216 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1187.gd540ebac.el9.x86_64 30/32 2024-04-09T11:53:27.216 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:53:27.216 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-09T11:53:27.216 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-09T11:53:27.216 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-09T11:53:27.216 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:27.218 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-09T11:53:27.307 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-04-09T11:53:27.308 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:27.308 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:53:27.308 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:27.308 INFO:teuthology.orchestra.run.smithi173.stdout: jq-1.6-16.el9.x86_64 2024-04-09T11:53:27.308 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:27.308 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-09T11:53:27.308 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-09T11:53:27.308 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-09T11:53:27.308 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:27.308 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:53:27.312 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-09T11:53:27.312 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-09T11:53:27.602 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph 2024-04-09T11:53:28.200 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:46 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:53:28.489 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:53:28.489 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:53:28.489 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:53:28.489 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.489 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:53:28.489 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.489 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:53:28.489 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.490 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:53:28.491 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:53:28.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:53:28.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:53:28.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:53:28.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:53:28.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:53:28.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:53:28.563 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:53:28.565 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:28.565 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-04-09T11:53:28.565 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:28.565 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 6.5 k 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 2.1 M 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 1.5 M 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 246 k 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 4.7 M 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 17 M 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-09T11:53:28.566 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-09T11:53:28.567 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:53:28.568 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:28.569 INFO:teuthology.orchestra.run.smithi173.stdout:Install 33 Packages 2024-04-09T11:53:28.569 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:28.569 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 29 M 2024-04-09T11:53:28.569 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 104 M 2024-04-09T11:53:28.569 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:53:28.647 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-09T11:53:28.647 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:18.2.2-1187.gd540ebac.el9.x86_64 1/32 2024-04-09T11:53:28.647 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 2/32 2024-04-09T11:53:28.647 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:18.2.2-1187.gd540ebac.el9.x86_64 3/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:18.2.2-1187.gd540ebac.el9.x86_64 4/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:18.2.2-1187.gd540ebac.el9.x86_64 5/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:18.2.2-1187.gd540ebac.el9.x86_6 6/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:18.2.2-1187.gd540ebac.el9.x86_64 7/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1187.gd540ebac.el9. 8/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:18.2.2-1187.gd540ebac.el9.x8 9/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:18.2.2-1187.gd540ebac.el9.x86_64 10/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:18.2.2-1187.gd540ebac.el9.x86_64 11/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:18.2.2-1187.gd540ebac.el9.x86_64 12/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:18.2.2-1187.gd540ebac.el9.x86_64 13/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-04-09T11:53:28.648 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-04-09T11:53:28.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-04-09T11:53:28.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-04-09T11:53:28.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-04-09T11:53:28.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-04-09T11:53:28.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-04-09T11:53:28.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-04-09T11:53:28.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-04-09T11:53:28.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-04-09T11:53:28.650 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-04-09T11:53:28.650 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-04-09T11:53:28.650 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-04-09T11:53:28.650 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:18.2.2-1187.gd540ebac.el9.x86_64 29/32 2024-04-09T11:53:28.650 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-04-09T11:53:28.650 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:18.2.2-1187.gd540ebac.el9.x86_64 31/32 2024-04-09T11:53:29.089 INFO:teuthology.orchestra.run.smithi173.stdout:(1/33): ceph-18.2.2-1187.gd540ebac.el9.x86_64.r 41 kB/s | 6.5 kB 00:00 2024-04-09T11:53:29.340 INFO:teuthology.orchestra.run.smithi173.stdout:(2/33): ceph-mgr-18.2.2-1187.gd540ebac.el9.x86_ 3.6 MB/s | 1.5 MB 00:00 2024-04-09T11:53:29.630 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-04-09T11:53:29.630 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:29.630 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2024-04-09T11:53:29.630 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.630 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.630 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:53:29.630 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-09T11:53:29.630 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.631 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:29.632 INFO:teuthology.orchestra.run.smithi029.stdout: re2-1:20211101-3.el9.x86_64 2024-04-09T11:53:29.633 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-09T11:53:29.633 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:29.633 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:53:29.674 INFO:teuthology.orchestra.run.smithi173.stdout:(3/33): ceph-mon-18.2.2-1187.gd540ebac.el9.x86_ 8.0 MB/s | 4.7 MB 00:00 2024-04-09T11:53:29.749 INFO:teuthology.orchestra.run.smithi173.stdout:(4/33): ceph-mds-18.2.2-1187.gd540ebac.el9.x86_ 2.6 MB/s | 2.1 MB 00:00 2024-04-09T11:53:29.774 INFO:teuthology.orchestra.run.smithi173.stdout:(5/33): ceph-mgr-modules-core-18.2.2-1187.gd540 2.4 MB/s | 246 kB 00:00 2024-04-09T11:53:30.041 INFO:teuthology.orchestra.run.smithi173.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 868 kB/s | 253 kB 00:00 2024-04-09T11:53:30.114 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-test 2024-04-09T11:53:30.250 INFO:teuthology.orchestra.run.smithi173.stdout:(7/33): ceph-osd-18.2.2-1187.gd540ebac.el9.x86_ 18 MB/s | 17 MB 00:00 2024-04-09T11:53:30.275 INFO:teuthology.orchestra.run.smithi173.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 456 kB/s | 106 kB 00:00 2024-04-09T11:53:30.367 INFO:teuthology.orchestra.run.smithi173.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 1.3 MB/s | 125 kB 00:00 2024-04-09T11:53:30.450 INFO:teuthology.orchestra.run.smithi173.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 1.8 MB/s | 1.2 MB 00:00 2024-04-09T11:53:30.476 INFO:teuthology.orchestra.run.smithi173.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 599 kB/s | 135 kB 00:00 2024-04-09T11:53:30.501 INFO:teuthology.orchestra.run.smithi173.stdout:(12/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.6 MB/s | 215 kB 00:00 2024-04-09T11:53:30.534 INFO:teuthology.orchestra.run.smithi173.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 592 kB/s | 35 kB 00:00 2024-04-09T11:53:30.560 INFO:teuthology.orchestra.run.smithi173.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-04-09T11:53:30.585 INFO:teuthology.orchestra.run.smithi173.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-04-09T11:53:30.610 INFO:teuthology.orchestra.run.smithi173.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2024-04-09T11:53:30.717 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:00:34 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:53:30.852 INFO:teuthology.orchestra.run.smithi173.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 149 kB/s | 43 kB 00:00 2024-04-09T11:53:30.944 INFO:teuthology.orchestra.run.smithi173.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 116 kB/s | 11 kB 00:00 2024-04-09T11:53:30.978 INFO:teuthology.orchestra.run.smithi173.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 438 kB/s | 172 kB 00:00 2024-04-09T11:53:31.025 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:53:31.025 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:53:31.025 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:53:31.025 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.025 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:53:31.025 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.025 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:53:31.025 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.025 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:53:31.025 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.025 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.026 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:53:31.027 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:53:31.028 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:53:31.029 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:53:31.030 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.033 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:53:31.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.034 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:53:31.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:53:31.044 INFO:teuthology.orchestra.run.smithi173.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 176 kB/s | 18 kB 00:00 2024-04-09T11:53:31.070 INFO:teuthology.orchestra.run.smithi173.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 252 kB/s | 23 kB 00:00 2024-04-09T11:53:31.095 INFO:teuthology.orchestra.run.smithi173.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 740 kB/s | 358 kB 00:00 2024-04-09T11:53:31.111 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:53:31.112 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:53:31.112 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-09T11:53:31.112 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:53:31.112 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:53:31.112 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 40 M 2024-04-09T11:53:31.112 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-09T11:53:31.112 INFO:teuthology.orchestra.run.smithi029.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-09T11:53:31.112 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 166 k 2024-04-09T11:53:31.112 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-09T11:53:31.113 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-09T11:53:31.113 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-09T11:53:31.113 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:31.113 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:53:31.113 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:53:31.113 INFO:teuthology.orchestra.run.smithi029.stdout:Install 6 Packages 2024-04-09T11:53:31.113 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:31.113 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 41 M 2024-04-09T11:53:31.114 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 164 M 2024-04-09T11:53:31.114 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:53:31.129 INFO:teuthology.orchestra.run.smithi173.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 232 kB/s | 19 kB 00:00 2024-04-09T11:53:31.154 INFO:teuthology.orchestra.run.smithi173.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 234 kB/s | 20 kB 00:00 2024-04-09T11:53:31.179 INFO:teuthology.orchestra.run.smithi173.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 551 kB/s | 46 kB 00:00 2024-04-09T11:53:31.246 INFO:teuthology.orchestra.run.smithi173.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 247 kB/s | 16 kB 00:00 2024-04-09T11:53:31.271 INFO:teuthology.orchestra.run.smithi173.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 554 kB/s | 79 kB 00:00 2024-04-09T11:53:31.297 INFO:teuthology.orchestra.run.smithi173.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-04-09T11:53:31.347 INFO:teuthology.orchestra.run.smithi173.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 897 kB/s | 90 kB 00:00 2024-04-09T11:53:31.372 INFO:teuthology.orchestra.run.smithi173.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 356 kB/s | 36 kB 00:00 2024-04-09T11:53:31.397 INFO:teuthology.orchestra.run.smithi173.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-09T11:53:31.439 INFO:teuthology.orchestra.run.smithi173.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 300 kB/s | 20 kB 00:00 2024-04-09T11:53:31.472 INFO:teuthology.orchestra.run.smithi029.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 742 kB/s | 187 kB 00:00 2024-04-09T11:53:31.506 INFO:teuthology.orchestra.run.smithi029.stdout:(2/6): libcephsqlite-18.2.2-1187.gd540ebac.el9. 580 kB/s | 166 kB 00:00 2024-04-09T11:53:31.531 INFO:teuthology.orchestra.run.smithi173.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.3 MB/s | 427 kB 00:00 2024-04-09T11:53:31.535 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:53:31.535 INFO:teuthology.orchestra.run.smithi173.stdout:Total 9.8 MB/s | 29 MB 00:02 2024-04-09T11:53:31.623 INFO:teuthology.orchestra.run.smithi029.stdout:(3/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 218 kB 00:00 2024-04-09T11:53:31.653 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:53:31.656 INFO:teuthology.orchestra.run.smithi029.stdout:(4/6): socat-1.7.4.1-5.el9.x86_64.rpm 2.0 MB/s | 305 kB 00:00 2024-04-09T11:53:31.689 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:53:31.689 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:53:31.707 INFO:teuthology.orchestra.run.smithi029.stdout:(5/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 759 kB/s | 64 kB 00:00 2024-04-09T11:53:32.043 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:53:32.044 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:53:33.301 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:53:33.359 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-09T11:53:33.391 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-09T11:53:33.424 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-09T11:53:33.474 INFO:teuthology.orchestra.run.smithi029.stdout:(6/6): ceph-test-18.2.2-1187.gd540ebac.el9.x86_ 18 MB/s | 40 MB 00:02 2024-04-09T11:53:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:53:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:Total 17 MB/s | 41 MB 00:02 2024-04-09T11:53:33.515 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-09T11:53:33.528 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:53:33.550 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:53:33.550 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:53:33.586 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-09T11:53:33.635 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-09T11:53:33.689 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-09T11:53:33.725 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-09T11:53:33.759 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-09T11:53:33.793 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-09T11:53:33.834 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-09T11:53:33.876 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-09T11:53:33.903 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:53:33.904 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:53:33.911 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-09T11:53:33.941 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-09T11:53:34.024 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-09T11:53:34.174 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-09T11:53:34.257 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-09T11:53:34.310 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-09T11:53:34.349 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-09T11:53:34.398 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-09T11:53:34.448 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:53:34.461 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-09T11:53:34.527 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-09T11:53:34.576 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-09T11:53:34.628 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-09T11:53:34.652 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-09T11:53:34.680 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-09T11:53:34.703 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-09T11:53:34.707 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:18.2.2-1187.gd540ebac.el9.x86_64 5/6 2024-04-09T11:53:34.773 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-09T11:53:34.863 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-09T11:53:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-09T11:53:35.018 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-09T11:53:35.167 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1187.gd540ebac.el9. 28/33 2024-04-09T11:53:35.195 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:18.2.2-1187.gd540ebac.el9.x86_64 29/33 2024-04-09T11:53:35.219 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1187.gd540ebac.el9.x86_64 29/33 2024-04-09T11:53:35.220 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:53:35.220 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-09T11:53:35.220 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-09T11:53:35.220 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-09T11:53:35.220 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:36.621 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:18.2.2-1187.gd540ebac.el9.x86_64 30/33 2024-04-09T11:53:36.647 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:18.2.2-1187.gd540ebac.el9.x86_64 30/33 2024-04-09T11:53:36.647 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:53:36.648 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-09T11:53:36.648 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-09T11:53:36.648 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-09T11:53:36.648 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:37.097 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:18.2.2-1187.gd540ebac.el9.x86_64 31/33 2024-04-09T11:53:37.121 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:18.2.2-1187.gd540ebac.el9.x86_64 31/33 2024-04-09T11:53:37.121 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:53:37.121 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-09T11:53:37.121 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-09T11:53:37.121 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-09T11:53:37.121 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:37.322 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:18.2.2-1187.gd540ebac.el9.x86_64 32/33 2024-04-09T11:53:37.345 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:18.2.2-1187.gd540ebac.el9.x86_64 32/33 2024-04-09T11:53:37.345 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:53:37.345 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-09T11:53:37.346 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-09T11:53:37.346 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-09T11:53:37.346 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:37.411 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:18.2.2-1187.gd540ebac.el9.x86_64 33/33 2024-04-09T11:53:38.638 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1187.gd540ebac.el9.x86_64 5/6 2024-04-09T11:53:38.739 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:18.2.2-1187.gd540ebac.el9.x86_64 6/6 2024-04-09T11:53:39.084 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-2:18.2.2-1187.gd540ebac.el9.x86_64 33/33 2024-04-09T11:53:39.084 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:18.2.2-1187.gd540ebac.el9.x86_64 1/33 2024-04-09T11:53:39.084 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:18.2.2-1187.gd540ebac.el9.x86_64 2/33 2024-04-09T11:53:39.084 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:18.2.2-1187.gd540ebac.el9.x86_64 3/33 2024-04-09T11:53:39.084 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:18.2.2-1187.gd540ebac.el9.x86_64 4/33 2024-04-09T11:53:39.084 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:18.2.2-1187.gd540ebac.el9.x86_64 5/33 2024-04-09T11:53:39.084 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1187.gd540ebac.el9. 6/33 2024-04-09T11:53:39.084 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-09T11:53:39.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-09T11:53:39.086 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-09T11:53:39.086 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-09T11:53:39.086 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-09T11:53:39.086 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-09T11:53:39.086 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-09T11:53:39.086 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-09T11:53:39.086 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-09T11:53:39.086 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-09T11:53:39.086 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-09T11:53:39.086 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-09T11:53:39.086 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-09T11:53:39.965 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-09T11:53:39.965 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:39.965 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:53:39.965 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:39.965 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:39.965 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-09T11:53:39.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply-3.11-14.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-09T11:53:39.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-09T11:53:39.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-09T11:53:39.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-09T11:53:39.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-09T11:53:39.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-09T11:53:39.968 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:39.968 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:53:40.356 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-base 2024-04-09T11:53:40.949 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:58 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:53:41.238 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:53:41.238 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:53:41.238 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:53:41.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.238 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:53:41.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.238 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:53:41.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.238 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:53:41.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.239 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.240 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:53:41.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:53:41.247 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-base-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:53:41.304 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:53:41.305 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-04-09T11:53:41.305 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:53:41.374 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install cephadm 2024-04-09T11:53:41.963 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:59 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:53:42.202 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-test-2:18.2.2-1187.gd540ebac.el9.x86_64 6/6 2024-04-09T11:53:42.202 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:18.2.2-1187.gd540ebac.el9.x86_64 1/6 2024-04-09T11:53:42.202 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:18.2.2-1187.gd540ebac.el9.x86_64 2/6 2024-04-09T11:53:42.202 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-04-09T11:53:42.203 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-04-09T11:53:42.203 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-04-09T11:53:42.251 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:53:42.251 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:53:42.251 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:53:42.251 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.251 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:53:42.251 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.251 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:53:42.251 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.251 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:53:42.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:53:42.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.258 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.260 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:53:42.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:53:42.318 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:53:42.319 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:42.319 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-04-09T11:53:42.319 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:42.319 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:53:42.319 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 224 k 2024-04-09T11:53:42.319 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:42.319 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:53:42.320 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:42.320 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:53:42.320 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:42.320 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 224 k 2024-04-09T11:53:42.320 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 216 k 2024-04-09T11:53:42.320 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:53:42.554 INFO:teuthology.orchestra.run.smithi173.stdout:cephadm-18.2.2-1187.gd540ebac.el9.noarch.rpm 956 kB/s | 224 kB 00:00 2024-04-09T11:53:42.555 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:53:42.555 INFO:teuthology.orchestra.run.smithi173.stdout:Total 951 kB/s | 224 kB 00:00 2024-04-09T11:53:42.555 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:53:42.560 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:53:42.560 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:53:42.563 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:53:42.563 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:53:42.632 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:53:42.662 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-04-09T11:53:42.662 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:42.662 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:53:42.662 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:42.662 INFO:teuthology.orchestra.run.smithi029.stdout: jq-1.6-16.el9.x86_64 2024-04-09T11:53:42.662 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:42.662 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-09T11:53:42.663 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-09T11:53:42.663 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-09T11:53:42.663 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:42.663 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:53:43.026 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph 2024-04-09T11:53:43.041 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 1/1 2024-04-09T11:53:43.134 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 1/1 2024-04-09T11:53:43.522 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 1/1 2024-04-09T11:53:43.637 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:00:47 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:53:43.819 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 1/1 2024-04-09T11:53:43.819 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:43.819 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:53:43.819 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:53:43.819 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:43.819 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:53:43.942 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:53:43.942 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:53:43.942 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.943 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:53:43.944 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.945 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.946 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:53:43.947 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.948 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.949 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.950 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.951 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.951 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.951 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:53:43.951 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.951 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.951 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:53:43.951 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.022 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:53:44.025 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:53:44.025 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-09T11:53:44.025 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:53:44.025 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:53:44.025 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 6.5 k 2024-04-09T11:53:44.025 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 2.1 M 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 1.5 M 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 246 k 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 4.7 M 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 17 M 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-09T11:53:44.026 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-09T11:53:44.027 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout:Install 33 Packages 2024-04-09T11:53:44.028 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:44.029 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 29 M 2024-04-09T11:53:44.029 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 104 M 2024-04-09T11:53:44.029 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:53:44.049 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-immutable-object-cache 2024-04-09T11:53:44.677 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:02 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:53:44.946 INFO:teuthology.orchestra.run.smithi029.stdout:(1/33): ceph-18.2.2-1187.gd540ebac.el9.x86_64.r 37 kB/s | 6.5 kB 00:00 2024-04-09T11:53:44.982 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:53:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:53:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:53:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:53:44.982 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.983 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:53:44.984 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.985 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:53:44.986 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:53:44.987 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.988 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.989 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.990 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:53:44.991 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:53:45.066 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 143 k 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 143 k 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 395 k 2024-04-09T11:53:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:53:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:(2/33): ceph-mgr-18.2.2-1187.gd540ebac.el9.x86_ 3.6 MB/s | 1.5 MB 00:00 2024-04-09T11:53:45.594 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-immutable-object-cache-18.2.2-1187.gd540eb 271 kB/s | 143 kB 00:00 2024-04-09T11:53:45.595 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:53:45.596 INFO:teuthology.orchestra.run.smithi173.stdout:Total 270 kB/s | 143 kB 00:00 2024-04-09T11:53:45.596 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:53:45.604 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:53:45.604 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:53:45.657 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:53:45.657 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:53:45.689 INFO:teuthology.orchestra.run.smithi029.stdout:(3/33): ceph-mon-18.2.2-1187.gd540ebac.el9.x86_ 6.3 MB/s | 4.7 MB 00:00 2024-04-09T11:53:45.772 INFO:teuthology.orchestra.run.smithi029.stdout:(4/33): ceph-mgr-modules-core-18.2.2-1187.gd540 2.9 MB/s | 246 kB 00:00 2024-04-09T11:53:45.807 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:53:45.870 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1187.gd540ebac. 1/1 2024-04-09T11:53:45.873 INFO:teuthology.orchestra.run.smithi029.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-04-09T11:53:45.897 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1187.gd540ebac. 1/1 2024-04-09T11:53:45.897 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:53:45.897 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-09T11:53:45.897 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:46.199 INFO:teuthology.orchestra.run.smithi029.stdout:(6/33): ceph-osd-18.2.2-1187.gd540ebac.el9.x86_ 16 MB/s | 17 MB 00:01 2024-04-09T11:53:46.293 INFO:teuthology.orchestra.run.smithi029.stdout:(7/33): ceph-mds-18.2.2-1187.gd540ebac.el9.x86_ 1.4 MB/s | 2.1 MB 00:01 2024-04-09T11:53:46.326 INFO:teuthology.orchestra.run.smithi029.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 838 kB/s | 106 kB 00:00 2024-04-09T11:53:46.377 INFO:teuthology.orchestra.run.smithi029.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 2.4 MB/s | 1.2 MB 00:00 2024-04-09T11:53:46.419 INFO:teuthology.orchestra.run.smithi029.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 1.0 MB/s | 135 kB 00:00 2024-04-09T11:53:46.453 INFO:teuthology.orchestra.run.smithi029.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 988 kB/s | 125 kB 00:00 2024-04-09T11:53:46.512 INFO:teuthology.orchestra.run.smithi029.stdout:(12/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.6 MB/s | 215 kB 00:00 2024-04-09T11:53:46.713 INFO:teuthology.orchestra.run.smithi029.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 134 kB/s | 35 kB 00:00 2024-04-09T11:53:46.855 INFO:teuthology.orchestra.run.smithi029.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 149 kB/s | 51 kB 00:00 2024-04-09T11:53:46.889 INFO:teuthology.orchestra.run.smithi029.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 237 kB/s | 42 kB 00:00 2024-04-09T11:53:46.928 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1187.gd540ebac. 1/1 2024-04-09T11:53:46.928 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:46.928 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:53:46.928 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:46.928 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:46.928 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:53:46.939 INFO:teuthology.orchestra.run.smithi029.stdout:(16/33): python3-mako-1.1.4-6.el9.noarch.rpm 331 kB/s | 172 kB 00:00 2024-04-09T11:53:47.157 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr 2024-04-09T11:53:47.309 INFO:teuthology.orchestra.run.smithi029.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 96 kB/s | 43 kB 00:00 2024-04-09T11:53:47.415 INFO:teuthology.orchestra.run.smithi029.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 98 kB/s | 11 kB 00:00 2024-04-09T11:53:47.491 INFO:teuthology.orchestra.run.smithi029.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 285 kB/s | 172 kB 00:00 2024-04-09T11:53:47.541 INFO:teuthology.orchestra.run.smithi029.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 141 kB/s | 18 kB 00:00 2024-04-09T11:53:47.600 INFO:teuthology.orchestra.run.smithi029.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 212 kB/s | 23 kB 00:00 2024-04-09T11:53:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 511 kB/s | 358 kB 00:00 2024-04-09T11:53:47.694 INFO:teuthology.orchestra.run.smithi029.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 127 kB/s | 19 kB 00:00 2024-04-09T11:53:47.720 INFO:teuthology.orchestra.run.smithi029.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 165 kB/s | 20 kB 00:00 2024-04-09T11:53:47.759 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:05 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:53:47.779 INFO:teuthology.orchestra.run.smithi029.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 423 kB/s | 46 kB 00:00 2024-04-09T11:53:47.888 INFO:teuthology.orchestra.run.smithi029.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 151 kB/s | 16 kB 00:00 2024-04-09T11:53:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 347 kB/s | 79 kB 00:00 2024-04-09T11:53:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-04-09T11:53:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 328 kB/s | 36 kB 00:00 2024-04-09T11:53:48.049 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:53:48.049 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:53:48.049 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:53:48.049 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:53:48.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:53:48.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:53:48.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:53:48.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:53:48.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:53:48.059 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-mgr-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:53:48.065 INFO:teuthology.orchestra.run.smithi029.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 509 kB/s | 90 kB 00:00 2024-04-09T11:53:48.099 INFO:teuthology.orchestra.run.smithi029.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-04-09T11:53:48.116 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:53:48.117 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-04-09T11:53:48.118 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:53:48.166 INFO:teuthology.orchestra.run.smithi029.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 199 kB/s | 20 kB 00:00 2024-04-09T11:53:48.181 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-dashboard 2024-04-09T11:53:48.316 INFO:teuthology.orchestra.run.smithi029.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.5 MB/s | 427 kB 00:00 2024-04-09T11:53:48.321 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:53:48.321 INFO:teuthology.orchestra.run.smithi029.stdout:Total 6.8 MB/s | 29 MB 00:04 2024-04-09T11:53:48.440 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:53:48.480 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:53:48.480 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:53:48.768 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:06 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:53:48.890 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:53:48.890 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:53:49.055 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:53:49.055 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:53:49.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:53:49.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:53:49.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:53:49.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:53:49.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:53:49.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:53:49.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:53:49.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.062 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:53:49.062 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.062 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.062 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.062 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.062 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:53:49.062 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.062 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.062 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.062 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.062 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.063 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.064 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.064 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:53:49.064 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.064 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.064 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.064 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:53:49.123 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:53:49.124 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:49.124 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-04-09T11:53:49.124 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:49.124 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:53:49.124 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 3.5 M 2024-04-09T11:53:49.124 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-04-09T11:53:49.124 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 24 k 2024-04-09T11:53:49.124 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 15 k 2024-04-09T11:53:49.124 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-09T11:53:49.125 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-09T11:53:49.125 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:49.125 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:53:49.125 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:53:49.125 INFO:teuthology.orchestra.run.smithi173.stdout:Install 5 Packages 2024-04-09T11:53:49.125 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:49.126 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 3.8 M 2024-04-09T11:53:49.126 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 87 M 2024-04-09T11:53:49.126 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:53:49.565 INFO:teuthology.orchestra.run.smithi173.stdout:(1/5): ceph-prometheus-alerts-18.2.2-1187.gd540 53 kB/s | 15 kB 00:00 2024-04-09T11:53:49.590 INFO:teuthology.orchestra.run.smithi173.stdout:(2/5): ceph-grafana-dashboards-18.2.2-1187.gd54 79 kB/s | 24 kB 00:00 2024-04-09T11:53:49.924 INFO:teuthology.orchestra.run.smithi173.stdout:(3/5): ceph-mgr-dashboard-18.2.2-1187.gd540ebac 5.5 MB/s | 3.5 MB 00:00 2024-04-09T11:53:50.015 INFO:teuthology.orchestra.run.smithi173.stdout:(4/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 68 kB/s | 31 kB 00:00 2024-04-09T11:53:50.167 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:53:50.217 INFO:teuthology.orchestra.run.smithi173.stdout:(5/5): python3-routes-2.5.1-5.el9.noarch.rpm 301 kB/s | 188 kB 00:00 2024-04-09T11:53:50.219 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:53:50.220 INFO:teuthology.orchestra.run.smithi173.stdout:Total 3.5 MB/s | 3.8 MB 00:01 2024-04-09T11:53:50.220 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:53:50.227 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:53:50.227 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:53:50.230 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-09T11:53:50.272 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-09T11:53:50.303 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:53:50.303 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:53:50.313 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-09T11:53:50.418 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-09T11:53:50.512 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-09T11:53:50.554 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:53:50.561 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-09T11:53:50.612 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-09T11:53:50.631 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-04-09T11:53:50.652 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-09T11:53:50.662 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-04-09T11:53:50.688 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-09T11:53:50.691 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1187.gd540ebac.el9.n 3/5 2024-04-09T11:53:50.730 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-09T11:53:50.780 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-09T11:53:50.832 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-09T11:53:50.867 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-09T11:53:50.906 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-09T11:53:50.999 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-09T11:53:51.151 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-09T11:53:51.248 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-09T11:53:51.309 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-09T11:53:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-09T11:53:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-09T11:53:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-09T11:53:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-09T11:53:51.752 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1187.gd540ebac.el9. 4/5 2024-04-09T11:53:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-09T11:53:51.795 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1187.gd540ebac.el9.noarc 5/5 2024-04-09T11:53:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-09T11:53:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-09T11:53:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-09T11:53:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-09T11:53:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1187.gd540ebac.el9. 28/33 2024-04-09T11:53:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:18.2.2-1187.gd540ebac.el9.x86_64 29/33 2024-04-09T11:53:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1187.gd540ebac.el9.x86_64 29/33 2024-04-09T11:53:52.372 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:53:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-09T11:53:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-09T11:53:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-09T11:53:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:52.838 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1187.gd540ebac.el9.noarc 5/5 2024-04-09T11:53:52.838 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1187.gd540ebac.el9. 1/5 2024-04-09T11:53:52.838 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1187.gd540ebac.el9.noarc 2/5 2024-04-09T11:53:52.838 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1187.gd540ebac.el9.n 3/5 2024-04-09T11:53:52.838 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-04-09T11:53:53.144 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-04-09T11:53:53.144 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:53.144 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:53:53.144 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:53:53.144 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:53:53.144 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:53:53.144 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-09T11:53:53.144 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-09T11:53:53.144 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:53.144 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:53:53.366 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-09T11:53:53.883 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:18.2.2-1187.gd540ebac.el9.x86_64 30/33 2024-04-09T11:53:53.909 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:18.2.2-1187.gd540ebac.el9.x86_64 30/33 2024-04-09T11:53:53.909 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:53:53.909 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-09T11:53:53.909 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-09T11:53:53.909 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-09T11:53:53.909 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:53.960 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:11 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:53:54.248 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:53:54.248 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:53:54.248 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:53:54.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.248 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:53:54.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.248 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:53:54.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.248 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.249 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.250 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.251 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.252 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.253 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.254 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:53:54.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:53:54.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:53:54.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:53:54.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.258 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:53:54.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:53:54.317 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:53:54.318 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-04-09T11:53:54.318 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-04-09T11:53:54.318 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-04-09T11:53:54.318 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:53:54.318 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 7.4 M 2024-04-09T11:53:54.318 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-04-09T11:53:54.318 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-09T11:53:54.318 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-09T11:53:54.318 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout:Install 12 Packages 2024-04-09T11:53:54.319 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:53:54.320 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 38 M 2024-04-09T11:53:54.320 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 209 M 2024-04-09T11:53:54.320 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:53:54.392 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:18.2.2-1187.gd540ebac.el9.x86_64 31/33 2024-04-09T11:53:54.415 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:18.2.2-1187.gd540ebac.el9.x86_64 31/33 2024-04-09T11:53:54.416 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:53:54.416 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-09T11:53:54.416 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-09T11:53:54.416 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-09T11:53:54.416 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:54.635 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:18.2.2-1187.gd540ebac.el9.x86_64 32/33 2024-04-09T11:53:54.658 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:18.2.2-1187.gd540ebac.el9.x86_64 32/33 2024-04-09T11:53:54.658 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:53:54.659 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-09T11:53:54.659 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-09T11:53:54.659 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-09T11:53:54.659 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:54.737 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:18.2.2-1187.gd540ebac.el9.x86_64 33/33 2024-04-09T11:53:54.873 INFO:teuthology.orchestra.run.smithi173.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 708 kB/s | 195 kB 00:00 2024-04-09T11:53:54.956 INFO:teuthology.orchestra.run.smithi173.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-04-09T11:53:55.082 INFO:teuthology.orchestra.run.smithi173.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 803 kB 00:00 2024-04-09T11:53:55.157 INFO:teuthology.orchestra.run.smithi173.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 15 MB/s | 3.0 MB 00:00 2024-04-09T11:53:55.183 INFO:teuthology.orchestra.run.smithi173.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 181 kB/s | 18 kB 00:00 2024-04-09T11:53:55.216 INFO:teuthology.orchestra.run.smithi173.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 602 kB/s | 35 kB 00:00 2024-04-09T11:53:55.258 INFO:teuthology.orchestra.run.smithi173.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-04-09T11:53:55.375 INFO:teuthology.orchestra.run.smithi173.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 44 MB/s | 5.1 MB 00:00 2024-04-09T11:53:55.450 INFO:teuthology.orchestra.run.smithi173.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2024-04-09T11:53:55.475 INFO:teuthology.orchestra.run.smithi173.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.4 MB/s | 250 kB 00:00 2024-04-09T11:53:55.718 INFO:teuthology.orchestra.run.smithi173.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 61 MB/s | 16 MB 00:00 2024-04-09T11:53:57.168 INFO:teuthology.orchestra.run.smithi173.stdout:(12/12): ceph-mgr-diskprediction-local-18.2.2-1 2.9 MB/s | 7.4 MB 00:02 2024-04-09T11:53:57.168 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:53:57.169 INFO:teuthology.orchestra.run.smithi173.stdout:Total 13 MB/s | 38 MB 00:02 2024-04-09T11:53:57.309 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-2:18.2.2-1187.gd540ebac.el9.x86_64 33/33 2024-04-09T11:53:57.309 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:18.2.2-1187.gd540ebac.el9.x86_64 1/33 2024-04-09T11:53:57.309 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:18.2.2-1187.gd540ebac.el9.x86_64 2/33 2024-04-09T11:53:57.309 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:18.2.2-1187.gd540ebac.el9.x86_64 3/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:18.2.2-1187.gd540ebac.el9.x86_64 4/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:18.2.2-1187.gd540ebac.el9.x86_64 5/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1187.gd540ebac.el9. 6/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-09T11:53:57.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-09T11:53:57.311 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-09T11:53:57.312 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-09T11:53:57.312 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-09T11:53:57.312 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-09T11:53:57.312 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-09T11:53:57.520 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:53:57.547 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:53:57.547 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:53:58.059 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:53:58.060 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:53:58.336 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-09T11:53:58.336 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:58.336 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:53:58.336 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-09T11:53:58.337 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply-3.11-14.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-09T11:53:58.338 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-09T11:53:58.339 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-09T11:53:58.339 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-09T11:53:58.339 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-09T11:53:58.339 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-09T11:53:58.339 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-09T11:53:58.339 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-09T11:53:58.339 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:53:58.339 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:53:58.752 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-base 2024-04-09T11:53:58.823 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:53:58.896 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-09T11:53:58.941 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-09T11:53:59.048 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-09T11:53:59.083 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-09T11:53:59.268 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-09T11:53:59.298 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-09T11:53:59.372 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:03 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:53:59.384 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-09T11:53:59.679 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:53:59.679 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:53:59.679 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:53:59.679 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.679 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:53:59.679 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.679 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:53:59.679 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.679 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:53:59.679 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:53:59.680 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.681 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:53:59.681 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.681 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:53:59.681 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.681 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:53:59.681 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.681 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:53:59.681 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.681 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:53:59.681 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.682 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:53:59.682 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.682 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:53:59.682 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.682 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:53:59.683 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.683 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:53:59.683 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.683 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:53:59.683 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.683 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:53:59.683 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.683 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:53:59.683 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.683 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:53:59.684 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.685 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:53:59.685 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.685 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:53:59.685 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.685 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:53:59.685 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.685 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:53:59.685 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.685 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.686 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.687 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:53:59.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.687 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:53:59.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:53:59.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:53:59.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:53:59.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:53:59.691 INFO:teuthology.orchestra.run.smithi029.stdout:Package ceph-base-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:53:59.751 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:53:59.752 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-04-09T11:53:59.752 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:53:59.841 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install cephadm 2024-04-09T11:54:00.024 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-09T11:54:00.136 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-09T11:54:00.441 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:04 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:00.743 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:00.743 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:00.743 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:00.743 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.743 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:00.743 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.743 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:00.743 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.744 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.745 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:00.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:00.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:00.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:00.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:00.814 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:00.815 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:00.815 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-09T11:54:00.815 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:00.815 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:54:00.815 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 224 k 2024-04-09T11:54:00.815 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:00.815 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:54:00.815 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:00.815 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T11:54:00.816 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:00.816 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 224 k 2024-04-09T11:54:00.816 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 216 k 2024-04-09T11:54:00.816 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:54:01.183 INFO:teuthology.orchestra.run.smithi029.stdout:cephadm-18.2.2-1187.gd540ebac.el9.noarch.rpm 611 kB/s | 224 kB 00:00 2024-04-09T11:54:01.184 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:01.184 INFO:teuthology.orchestra.run.smithi029.stdout:Total 608 kB/s | 224 kB 00:00 2024-04-09T11:54:01.184 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:54:01.189 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:54:01.189 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:54:01.192 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:54:01.192 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:54:01.268 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:54:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-09T11:54:01.724 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 1/1 2024-04-09T11:54:01.813 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 1/1 2024-04-09T11:54:02.247 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 1/1 2024-04-09T11:54:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-09T11:54:02.456 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1187.gd540e 12/12 2024-04-09T11:54:02.575 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 1/1 2024-04-09T11:54:02.575 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:02.576 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:54:02.576 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:02.576 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:02.576 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:02.829 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-immutable-object-cache 2024-04-09T11:54:03.441 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:07 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:03.746 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:03.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:03.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:03.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:03.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:03.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:03.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:03.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:03.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:03.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:03.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:03.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:03.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:03.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:03.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:03.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:03.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:03.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:03.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:03.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:03.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:03.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:03.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:03.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:03.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:03.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:03.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:03.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.752 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:03.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.752 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:03.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.752 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:03.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.752 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:03.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.752 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:03.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.753 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:03.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.753 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:03.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.755 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:03.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.755 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:03.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.756 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:03.756 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.756 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.756 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.756 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.756 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:03.756 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.756 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.756 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.756 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:03.819 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:03.820 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:03.820 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T11:54:03.820 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:03.820 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:54:03.821 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 143 k 2024-04-09T11:54:03.821 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:03.821 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:54:03.821 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:03.821 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T11:54:03.821 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:03.821 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 143 k 2024-04-09T11:54:03.821 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 395 k 2024-04-09T11:54:03.821 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:54:04.208 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-immutable-object-cache-18.2.2-1187.gd540eb 369 kB/s | 143 kB 00:00 2024-04-09T11:54:04.208 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:04.209 INFO:teuthology.orchestra.run.smithi029.stdout:Total 367 kB/s | 143 kB 00:00 2024-04-09T11:54:04.209 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:54:04.217 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:54:04.217 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:54:04.272 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:54:04.272 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:54:04.412 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:54:04.486 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1187.gd540ebac. 1/1 2024-04-09T11:54:04.511 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1187.gd540ebac. 1/1 2024-04-09T11:54:04.511 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:54:04.511 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-09T11:54:04.511 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1187.gd540e 12/12 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1187.gd540e 1/12 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-09T11:54:05.007 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-09T11:54:05.477 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-09T11:54:05.477 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:05.477 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-09T11:54:05.478 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:05.479 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:05.547 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1187.gd540ebac. 1/1 2024-04-09T11:54:05.547 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:05.547 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:54:05.547 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:54:05.547 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:05.547 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:05.831 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-rook 2024-04-09T11:54:05.862 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr 2024-04-09T11:54:06.433 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:24 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:10 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:06.722 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:06.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:06.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:06.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:06.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:06.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:06.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:06.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:06.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:06.730 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.731 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.731 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.731 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.731 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:06.731 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.731 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.731 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.731 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.731 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:06.731 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.731 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.732 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.766 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:06.767 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:06.767 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:06.767 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.767 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:06.767 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.767 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:06.767 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.767 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:06.767 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.767 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:06.768 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.768 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:06.768 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.768 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:06.768 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.768 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:06.768 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.768 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:06.768 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.768 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:06.769 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.769 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:06.769 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.769 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:06.769 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.769 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:06.769 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.769 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:06.770 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.770 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:06.770 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.770 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:06.770 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.770 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:06.770 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.770 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:06.770 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.770 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:06.770 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:06.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:06.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:06.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:06.777 INFO:teuthology.orchestra.run.smithi029.stdout:Package ceph-mgr-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:06.791 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:06.792 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:06.792 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-04-09T11:54:06.793 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:06.793 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:54:06.793 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 49 k 2024-04-09T11:54:06.793 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-04-09T11:54:06.793 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-09T11:54:06.793 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-09T11:54:06.793 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-09T11:54:06.794 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-09T11:54:06.794 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-09T11:54:06.794 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-09T11:54:06.794 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-09T11:54:06.794 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-09T11:54:06.794 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-09T11:54:06.794 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-09T11:54:06.794 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-09T11:54:06.795 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-09T11:54:06.795 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:06.795 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:54:06.795 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:06.795 INFO:teuthology.orchestra.run.smithi173.stdout:Install 13 Packages 2024-04-09T11:54:06.795 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:06.795 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 2.2 M 2024-04-09T11:54:06.795 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 26 M 2024-04-09T11:54:06.796 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:54:06.838 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:06.840 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-04-09T11:54:06.840 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:06.924 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-dashboard 2024-04-09T11:54:07.372 INFO:teuthology.orchestra.run.smithi173.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 264 kB/s | 26 kB 00:00 2024-04-09T11:54:07.397 INFO:teuthology.orchestra.run.smithi173.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 157 kB/s | 19 kB 00:00 2024-04-09T11:54:07.481 INFO:teuthology.orchestra.run.smithi173.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-04-09T11:54:07.506 INFO:teuthology.orchestra.run.smithi173.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-04-09T11:54:07.522 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:11 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:07.539 INFO:teuthology.orchestra.run.smithi173.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.7 MB/s | 279 kB 00:00 2024-04-09T11:54:07.565 INFO:teuthology.orchestra.run.smithi173.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 908 kB/s | 54 kB 00:00 2024-04-09T11:54:07.590 INFO:teuthology.orchestra.run.smithi173.stdout:(7/13): ceph-mgr-rook-18.2.2-1187.gd540ebac.el9 156 kB/s | 49 kB 00:00 2024-04-09T11:54:07.829 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:07.829 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:07.829 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:07.829 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.829 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:07.829 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.830 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:07.830 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.830 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:07.830 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.830 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:07.830 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.830 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:07.830 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.830 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:07.830 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:07.831 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:07.832 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.833 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:07.833 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.833 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:07.833 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.833 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:07.833 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.833 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:07.833 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.833 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:07.833 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.833 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:07.834 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.834 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:07.834 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.834 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:07.834 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.834 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:07.834 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.834 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:07.834 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.834 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:07.835 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.835 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:07.835 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.835 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:07.835 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.835 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:07.835 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:07.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:07.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:07.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:07.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:07.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.837 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:07.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.838 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi173.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 110 kB/s | 32 kB 00:00 2024-04-09T11:54:07.857 INFO:teuthology.orchestra.run.smithi173.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 51 kB/s | 15 kB 00:00 2024-04-09T11:54:07.902 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:07.903 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-09T11:54:07.903 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:07.903 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:54:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 3.5 M 2024-04-09T11:54:07.903 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-09T11:54:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 24 k 2024-04-09T11:54:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 15 k 2024-04-09T11:54:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-09T11:54:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-09T11:54:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:07.904 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:54:07.904 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:07.904 INFO:teuthology.orchestra.run.smithi029.stdout:Install 5 Packages 2024-04-09T11:54:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:07.904 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 3.8 M 2024-04-09T11:54:07.905 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 87 M 2024-04-09T11:54:07.905 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:54:08.099 INFO:teuthology.orchestra.run.smithi173.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 398 kB/s | 203 kB 00:00 2024-04-09T11:54:08.208 INFO:teuthology.orchestra.run.smithi173.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 169 kB/s | 59 kB 00:00 2024-04-09T11:54:08.386 INFO:teuthology.orchestra.run.smithi029.stdout:(1/5): ceph-prometheus-alerts-18.2.2-1187.gd540 53 kB/s | 15 kB 00:00 2024-04-09T11:54:08.412 INFO:teuthology.orchestra.run.smithi029.stdout:(2/5): ceph-grafana-dashboards-18.2.2-1187.gd54 80 kB/s | 24 kB 00:00 2024-04-09T11:54:08.525 INFO:teuthology.orchestra.run.smithi173.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 211 kB/s | 90 kB 00:00 2024-04-09T11:54:08.583 INFO:teuthology.orchestra.run.smithi173.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.4 MB/s | 1.0 MB 00:00 2024-04-09T11:54:08.584 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:08.584 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2024-04-09T11:54:08.655 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:54:08.670 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:54:08.671 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:54:08.704 INFO:teuthology.orchestra.run.smithi029.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 97 kB/s | 31 kB 00:00 2024-04-09T11:54:08.767 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:54:08.773 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:54:08.954 INFO:teuthology.orchestra.run.smithi029.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 348 kB/s | 188 kB 00:00 2024-04-09T11:54:09.038 INFO:teuthology.orchestra.run.smithi029.stdout:(5/5): ceph-mgr-dashboard-18.2.2-1187.gd540ebac 3.8 MB/s | 3.5 MB 00:00 2024-04-09T11:54:09.040 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:09.040 INFO:teuthology.orchestra.run.smithi029.stdout:Total 3.3 MB/s | 3.8 MB 00:01 2024-04-09T11:54:09.041 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:54:09.049 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:54:09.049 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:54:09.127 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:54:09.127 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:54:09.285 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:54:09.415 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:54:09.464 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-09T11:54:09.506 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-04-09T11:54:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-09T11:54:09.554 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-04-09T11:54:09.590 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-09T11:54:09.592 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1187.gd540ebac.el9.n 3/5 2024-04-09T11:54:09.627 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-09T11:54:09.676 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-09T11:54:09.780 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-09T11:54:09.881 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-09T11:54:09.937 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-09T11:54:10.662 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-09T11:54:10.702 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1187.gd540ebac.el9. 4/5 2024-04-09T11:54:10.708 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-09T11:54:10.751 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-09T11:54:10.756 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1187.gd540ebac.el9.noarc 5/5 2024-04-09T11:54:10.798 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-09T11:54:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:18.2.2-1187.gd540ebac.el9.noarch 13/13 2024-04-09T11:54:11.688 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1187.gd540ebac.el9.noarch 13/13 2024-04-09T11:54:11.688 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1187.gd540ebac.el9.noarch 1/13 2024-04-09T11:54:11.688 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-09T11:54:11.688 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-09T11:54:11.689 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-09T11:54:11.689 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-09T11:54:11.689 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-09T11:54:11.689 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-09T11:54:11.689 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-09T11:54:11.689 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-09T11:54:11.689 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-09T11:54:11.689 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-09T11:54:11.689 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-09T11:54:12.065 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-09T11:54:12.065 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:12.065 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:54:12.065 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:12.065 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-09T11:54:12.065 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-09T11:54:12.065 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-09T11:54:12.066 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-09T11:54:12.066 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-09T11:54:12.066 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-09T11:54:12.066 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-09T11:54:12.066 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-09T11:54:12.066 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-09T11:54:12.066 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-09T11:54:12.066 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-09T11:54:12.066 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-09T11:54:12.066 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:12.066 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:12.354 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-cephadm 2024-04-09T11:54:12.649 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1187.gd540ebac.el9.noarc 5/5 2024-04-09T11:54:12.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1187.gd540ebac.el9. 1/5 2024-04-09T11:54:12.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1187.gd540ebac.el9.noarc 2/5 2024-04-09T11:54:12.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1187.gd540ebac.el9.n 3/5 2024-04-09T11:54:12.649 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-04-09T11:54:12.949 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:30 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:12.964 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-04-09T11:54:12.964 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:12.964 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:54:12.964 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:12.964 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:12.964 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:12.964 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-09T11:54:12.964 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-09T11:54:12.964 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:12.964 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:13.215 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-09T11:54:13.240 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:13.240 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:13.240 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:13.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.240 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:13.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:13.241 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:13.242 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.243 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:13.244 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.245 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.246 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:13.247 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.248 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.249 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:13.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.249 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:13.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.249 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:13.309 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:13.310 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:13.310 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-04-09T11:54:13.310 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:13.310 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:54:13.310 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 138 k 2024-04-09T11:54:13.310 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-04-09T11:54:13.311 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-09T11:54:13.311 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-09T11:54:13.311 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-09T11:54:13.311 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-09T11:54:13.311 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-09T11:54:13.311 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:13.311 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:54:13.311 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:13.311 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2024-04-09T11:54:13.311 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:13.312 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 7.0 M 2024-04-09T11:54:13.312 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 33 M 2024-04-09T11:54:13.312 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:54:13.776 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 986 kB/s | 248 kB 00:00 2024-04-09T11:54:13.822 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:17 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:13.885 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): ceph-mgr-cephadm-18.2.2-1187.gd540ebac.e 384 kB/s | 138 kB 00:00 2024-04-09T11:54:14.010 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.3 MB/s | 548 kB 00:00 2024-04-09T11:54:14.035 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 384 kB/s | 58 kB 00:00 2024-04-09T11:54:14.061 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 1.0 MB/s | 51 kB 00:00 2024-04-09T11:54:14.130 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:14.130 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:14.130 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:14.130 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.131 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:14.132 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.133 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.134 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.135 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:14.136 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.137 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.138 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.139 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.140 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.140 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:14.205 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:14.207 INFO:teuthology.orchestra.run.smithi029.stdout:======================================================================================= 2024-04-09T11:54:14.207 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-09T11:54:14.207 INFO:teuthology.orchestra.run.smithi029.stdout:======================================================================================= 2024-04-09T11:54:14.207 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:54:14.207 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 7.4 M 2024-04-09T11:54:14.207 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-09T11:54:14.207 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-09T11:54:14.207 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-09T11:54:14.207 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-09T11:54:14.207 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout:======================================================================================= 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout:Install 12 Packages 2024-04-09T11:54:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:14.209 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 38 M 2024-04-09T11:54:14.209 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 209 M 2024-04-09T11:54:14.209 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:54:14.582 INFO:teuthology.orchestra.run.smithi029.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 721 kB/s | 195 kB 00:00 2024-04-09T11:54:14.640 INFO:teuthology.orchestra.run.smithi029.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-04-09T11:54:14.901 INFO:teuthology.orchestra.run.smithi029.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2024-04-09T11:54:14.952 INFO:teuthology.orchestra.run.smithi029.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 362 kB/s | 18 kB 00:00 2024-04-09T11:54:15.036 INFO:teuthology.orchestra.run.smithi029.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.6 MB/s | 3.0 MB 00:00 2024-04-09T11:54:15.061 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.9 MB/s | 6.0 MB 00:01 2024-04-09T11:54:15.061 INFO:teuthology.orchestra.run.smithi029.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 322 kB/s | 35 kB 00:00 2024-04-09T11:54:15.062 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:15.063 INFO:teuthology.orchestra.run.smithi173.stdout:Total 4.0 MB/s | 7.0 MB 00:01 2024-04-09T11:54:15.133 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:54:15.144 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:54:15.144 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:54:15.170 INFO:teuthology.orchestra.run.smithi029.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-04-09T11:54:15.245 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:54:15.246 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:54:15.555 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:54:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 8.3 MB/s | 4.7 MB 00:00 2024-04-09T11:54:15.732 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-09T11:54:15.746 INFO:teuthology.orchestra.run.smithi029.stdout:(9/12): ceph-mgr-diskprediction-local-18.2.2-11 5.1 MB/s | 7.4 MB 00:01 2024-04-09T11:54:15.795 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-09T11:54:15.880 INFO:teuthology.orchestra.run.smithi029.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.2 MB/s | 5.1 MB 00:00 2024-04-09T11:54:15.939 INFO:teuthology.orchestra.run.smithi029.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 749 kB/s | 250 kB 00:00 2024-04-09T11:54:16.306 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-09T11:54:16.389 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-09T11:54:16.451 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-09T11:54:16.475 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 6/6 2024-04-09T11:54:16.706 INFO:teuthology.orchestra.run.smithi029.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-04-09T11:54:16.706 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:16.707 INFO:teuthology.orchestra.run.smithi029.stdout:Total 15 MB/s | 38 MB 00:02 2024-04-09T11:54:17.066 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:54:17.094 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:54:17.094 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:54:17.297 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 6/6 2024-04-09T11:54:17.297 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 1/6 2024-04-09T11:54:17.297 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-09T11:54:17.297 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-09T11:54:17.297 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-09T11:54:17.297 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-09T11:54:17.628 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:54:17.628 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:54:17.641 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-09T11:54:17.641 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:54:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-09T11:54:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-09T11:54:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-09T11:54:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-09T11:54:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-09T11:54:17.646 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:17.907 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-fuse 2024-04-09T11:54:18.411 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:54:18.494 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-09T11:54:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:36 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:18.539 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-09T11:54:18.654 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-09T11:54:18.693 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-09T11:54:18.802 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:18.802 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.803 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:18.804 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.805 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:18.806 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:18.807 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.808 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:18.875 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:18.875 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:18.875 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-04-09T11:54:18.875 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:18.875 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:54:18.875 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 848 k 2024-04-09T11:54:18.875 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-04-09T11:54:18.875 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-09T11:54:18.875 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:18.876 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:54:18.876 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:18.876 INFO:teuthology.orchestra.run.smithi173.stdout:Install 2 Packages 2024-04-09T11:54:18.876 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:18.876 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 928 k 2024-04-09T11:54:18.876 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.7 M 2024-04-09T11:54:18.876 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:54:18.876 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-09T11:54:18.900 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-09T11:54:18.993 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-09T11:54:19.229 INFO:teuthology.orchestra.run.smithi173.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 843 kB/s | 80 kB 00:00 2024-04-09T11:54:19.682 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-09T11:54:19.807 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-09T11:54:19.963 INFO:teuthology.orchestra.run.smithi173.stdout:(2/2): ceph-fuse-18.2.2-1187.gd540ebac.el9.x86_ 1.0 MB/s | 848 kB 00:00 2024-04-09T11:54:19.963 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:19.963 INFO:teuthology.orchestra.run.smithi173.stdout:Total 851 kB/s | 928 kB 00:01 2024-04-09T11:54:19.975 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:54:19.998 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:54:19.998 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:54:20.074 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:54:20.075 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:54:20.269 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:54:20.403 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-09T11:54:20.480 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 2/2 2024-04-09T11:54:21.130 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-09T11:54:21.159 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 2/2 2024-04-09T11:54:21.159 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 1/2 2024-04-09T11:54:21.479 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-09T11:54:21.479 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:21.479 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:54:21.479 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-09T11:54:21.479 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:21.479 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:21.749 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-volume 2024-04-09T11:54:22.233 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-09T11:54:22.265 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1187.gd540e 12/12 2024-04-09T11:54:22.369 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:40 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:22.658 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:22.658 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:22.658 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:22.658 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.658 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:22.658 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.658 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:22.658 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:22.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.661 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.662 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:22.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.665 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.666 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.667 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.667 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:22.667 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.667 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.667 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.667 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.667 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:22.667 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.667 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.667 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.667 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:22.726 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:22.727 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:22.727 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-04-09T11:54:22.727 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:22.727 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:54:22.727 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 264 k 2024-04-09T11:54:22.727 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-04-09T11:54:22.728 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-09T11:54:22.728 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:22.728 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:54:22.728 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:22.728 INFO:teuthology.orchestra.run.smithi173.stdout:Install 2 Packages 2024-04-09T11:54:22.728 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:22.728 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 341 k 2024-04-09T11:54:22.728 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 1.5 M 2024-04-09T11:54:22.728 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:54:22.984 INFO:teuthology.orchestra.run.smithi173.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 1.0 MB/s | 77 kB 00:00 2024-04-09T11:54:23.459 INFO:teuthology.orchestra.run.smithi173.stdout:(2/2): ceph-volume-18.2.2-1187.gd540ebac.el9.no 480 kB/s | 264 kB 00:00 2024-04-09T11:54:23.460 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:23.460 INFO:teuthology.orchestra.run.smithi173.stdout:Total 465 kB/s | 341 kB 00:00 2024-04-09T11:54:23.472 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:54:23.481 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:54:23.481 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:54:23.519 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:54:23.519 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:54:23.669 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:54:23.849 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-09T11:54:23.887 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:18.2.2-1187.gd540ebac.el9.noarch 2/2 2024-04-09T11:54:23.903 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:18.2.2-1187.gd540ebac.el9.noarch 2/2 2024-04-09T11:54:23.903 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:54:23.903 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-09T11:54:23.903 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:24.592 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:18.2.2-1187.gd540ebac.el9.noarch 1/2 2024-04-09T11:54:24.967 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-09T11:54:24.967 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:24.967 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:54:24.967 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:24.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-09T11:54:24.968 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:24.968 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:25.349 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados-devel 2024-04-09T11:54:25.962 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:43 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:26.254 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:26.254 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:26.254 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.255 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:26.256 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:26.257 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.258 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:26.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.258 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:26.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.258 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:26.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.258 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:26.258 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.258 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:26.259 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:26.260 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.261 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.262 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.263 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.264 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:26.324 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:26.325 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:26.325 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:54:26.325 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:26.325 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:54:26.325 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 127 k 2024-04-09T11:54:26.325 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:26.325 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:54:26.326 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:26.326 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:54:26.326 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:26.326 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 127 k 2024-04-09T11:54:26.326 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 456 k 2024-04-09T11:54:26.326 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:54:26.396 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1187.gd540e 12/12 2024-04-09T11:54:26.396 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1187.gd540e 1/12 2024-04-09T11:54:26.396 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-09T11:54:26.396 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-09T11:54:26.397 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-09T11:54:26.397 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-09T11:54:26.397 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-09T11:54:26.397 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-09T11:54:26.397 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-09T11:54:26.397 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-04-09T11:54:26.397 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-09T11:54:26.397 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-09T11:54:26.559 INFO:teuthology.orchestra.run.smithi173.stdout:librados-devel-18.2.2-1187.gd540ebac.el9.x86_64 543 kB/s | 127 kB 00:00 2024-04-09T11:54:26.560 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:26.560 INFO:teuthology.orchestra.run.smithi173.stdout:Total 540 kB/s | 127 kB 00:00 2024-04-09T11:54:26.560 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:54:26.566 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:54:26.566 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:54:26.625 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:54:26.625 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:54:26.776 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:54:26.866 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:26.897 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-09T11:54:26.897 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:26.897 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:54:26.897 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:26.897 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-09T11:54:26.897 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-09T11:54:26.897 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-09T11:54:26.897 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-09T11:54:26.897 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-09T11:54:26.897 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-09T11:54:26.897 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-09T11:54:26.898 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-09T11:54:26.898 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-09T11:54:26.898 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-09T11:54:26.898 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-09T11:54:26.898 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:26.898 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:27.350 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:27.355 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-rook 2024-04-09T11:54:27.648 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:27.648 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:27.648 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:54:27.648 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:54:27.648 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:27.648 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:27.902 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs2 2024-04-09T11:54:27.963 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:31 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:28.266 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:28.266 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:28.266 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:28.266 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.266 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:28.266 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:28.267 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.268 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.269 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:28.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.340 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:28.341 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:28.341 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-09T11:54:28.341 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:28.341 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:54:28.341 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 49 k 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-09T11:54:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-09T11:54:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:28.343 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:54:28.343 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:28.343 INFO:teuthology.orchestra.run.smithi029.stdout:Install 13 Packages 2024-04-09T11:54:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:28.343 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 2.2 M 2024-04-09T11:54:28.343 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 26 M 2024-04-09T11:54:28.344 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:54:28.516 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:46 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:28.615 INFO:teuthology.orchestra.run.smithi029.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 197 kB/s | 19 kB 00:00 2024-04-09T11:54:28.640 INFO:teuthology.orchestra.run.smithi029.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 208 kB/s | 26 kB 00:00 2024-04-09T11:54:28.724 INFO:teuthology.orchestra.run.smithi029.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-04-09T11:54:28.750 INFO:teuthology.orchestra.run.smithi029.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-04-09T11:54:28.775 INFO:teuthology.orchestra.run.smithi029.stdout:(5/13): ceph-mgr-rook-18.2.2-1187.gd540ebac.el9 191 kB/s | 49 kB 00:00 2024-04-09T11:54:28.801 INFO:teuthology.orchestra.run.smithi029.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-04-09T11:54:28.808 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:28.808 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:28.808 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:28.808 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.808 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:28.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:28.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.814 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:28.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.814 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:28.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:28.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.816 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:28.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.817 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:28.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:28.818 INFO:teuthology.orchestra.run.smithi173.stdout:Package libcephfs2-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:28.826 INFO:teuthology.orchestra.run.smithi029.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-04-09T11:54:28.878 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:28.879 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-04-09T11:54:28.880 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:28.947 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs-devel 2024-04-09T11:54:29.168 INFO:teuthology.orchestra.run.smithi029.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 41 kB/s | 15 kB 00:00 2024-04-09T11:54:29.194 INFO:teuthology.orchestra.run.smithi029.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 77 kB/s | 32 kB 00:00 2024-04-09T11:54:29.461 INFO:teuthology.orchestra.run.smithi029.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 319 kB/s | 203 kB 00:00 2024-04-09T11:54:29.549 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:47 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:29.562 INFO:teuthology.orchestra.run.smithi029.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 161 kB/s | 59 kB 00:00 2024-04-09T11:54:29.771 INFO:teuthology.orchestra.run.smithi029.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 1.7 MB/s | 1.0 MB 00:00 2024-04-09T11:54:29.796 INFO:teuthology.orchestra.run.smithi029.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 268 kB/s | 90 kB 00:00 2024-04-09T11:54:29.799 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:29.800 INFO:teuthology.orchestra.run.smithi029.stdout:Total 1.5 MB/s | 2.2 MB 00:01 2024-04-09T11:54:29.837 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:29.838 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:29.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:29.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:29.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:29.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:29.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:29.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:29.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:29.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.842 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:29.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:29.869 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:54:29.886 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:54:29.886 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:54:29.907 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:29.908 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:29.908 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:54:29.908 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:29.908 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:54:29.908 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 31 k 2024-04-09T11:54:29.908 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:29.908 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:54:29.909 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:29.909 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:54:29.909 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:29.909 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 31 k 2024-04-09T11:54:29.909 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 139 k 2024-04-09T11:54:29.910 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:54:29.988 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:54:29.988 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:54:30.071 INFO:teuthology.orchestra.run.smithi173.stdout:libcephfs-devel-18.2.2-1187.gd540ebac.el9.x86_6 192 kB/s | 31 kB 00:00 2024-04-09T11:54:30.072 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:30.072 INFO:teuthology.orchestra.run.smithi173.stdout:Total 190 kB/s | 31 kB 00:00 2024-04-09T11:54:30.073 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:54:30.075 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:54:30.075 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:54:30.105 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:54:30.106 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:54:30.197 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:54:30.303 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:30.523 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:54:30.686 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:30.703 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-09T11:54:30.769 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-09T11:54:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-09T11:54:30.879 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-09T11:54:30.921 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-09T11:54:30.973 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:30.973 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:30.973 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:54:30.973 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:54:30.973 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:30.973 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:31.036 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-09T11:54:31.148 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-09T11:54:31.162 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados2 2024-04-09T11:54:31.211 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-09T11:54:31.760 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:49 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:31.991 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-09T11:54:32.050 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:32.050 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:32.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:32.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:32.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:32.060 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-09T11:54:32.060 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:32.096 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-09T11:54:32.120 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:32.121 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-04-09T11:54:32.122 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:32.146 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-09T11:54:32.175 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:18.2.2-1187.gd540ebac.el9.noarch 13/13 2024-04-09T11:54:32.186 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librbd1 2024-04-09T11:54:32.788 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:50 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:33.087 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:33.087 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:33.087 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:33.087 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.087 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:33.087 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.087 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:33.087 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.087 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:33.087 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.087 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:33.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:33.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.094 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.096 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:33.096 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.096 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.096 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.096 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:33.096 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:33.155 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:33.156 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-04-09T11:54:33.156 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:33.165 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1187.gd540ebac.el9.noarch 13/13 2024-04-09T11:54:33.165 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1187.gd540ebac.el9.noarch 1/13 2024-04-09T11:54:33.165 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-09T11:54:33.165 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-09T11:54:33.165 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-09T11:54:33.165 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-09T11:54:33.166 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-09T11:54:33.166 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-09T11:54:33.166 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-09T11:54:33.166 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-09T11:54:33.166 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-09T11:54:33.166 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-09T11:54:33.166 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-09T11:54:33.226 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rados 2024-04-09T11:54:33.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-09T11:54:33.562 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:33.562 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:54:33.562 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:33.563 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:33.826 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:51 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:33.892 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-cephadm 2024-04-09T11:54:34.115 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:34.115 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:34.116 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:34.117 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:34.118 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.119 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:34.120 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.121 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:34.121 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.121 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:34.121 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.121 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:34.121 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.121 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:34.121 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.121 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.121 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.122 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:34.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.125 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.125 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.125 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.125 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rados-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:34.184 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:34.185 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-04-09T11:54:34.185 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:34.251 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rgw 2024-04-09T11:54:34.503 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:38 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:34.812 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:34.812 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.813 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.814 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:34.815 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:34.816 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.817 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:34.818 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.819 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.820 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.821 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:34.854 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:52 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:34.887 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:34.888 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:34.888 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-09T11:54:34.888 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:34.888 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:54:34.888 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 138 k 2024-04-09T11:54:34.889 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-09T11:54:34.889 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-09T11:54:34.889 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-09T11:54:34.889 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-09T11:54:34.889 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-09T11:54:34.889 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-09T11:54:34.889 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:34.889 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:54:34.889 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:34.889 INFO:teuthology.orchestra.run.smithi029.stdout:Install 6 Packages 2024-04-09T11:54:34.889 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:34.890 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 7.0 M 2024-04-09T11:54:34.890 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 33 M 2024-04-09T11:54:34.890 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:54:35.147 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:35.147 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:35.147 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:35.147 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.147 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:35.147 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.147 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:35.148 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.149 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:35.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:35.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.156 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:35.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:35.156 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rgw-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:35.216 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:35.217 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-04-09T11:54:35.217 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:35.283 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-cephfs 2024-04-09T11:54:35.498 INFO:teuthology.orchestra.run.smithi029.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-04-09T11:54:35.524 INFO:teuthology.orchestra.run.smithi029.stdout:(2/6): ceph-mgr-cephadm-18.2.2-1187.gd540ebac.e 599 kB/s | 138 kB 00:00 2024-04-09T11:54:35.849 INFO:teuthology.orchestra.run.smithi029.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 177 kB/s | 58 kB 00:00 2024-04-09T11:54:35.882 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:53 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:35.983 INFO:teuthology.orchestra.run.smithi029.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2024-04-09T11:54:36.009 INFO:teuthology.orchestra.run.smithi029.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 321 kB/s | 51 kB 00:00 2024-04-09T11:54:36.171 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:36.171 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:36.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:36.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:36.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:36.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:36.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:36.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:36.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.181 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:36.181 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.181 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.181 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.181 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:36.181 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-cephfs-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:36.241 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:36.242 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-04-09T11:54:36.242 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:36.316 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rbd 2024-04-09T11:54:36.809 INFO:teuthology.orchestra.run.smithi029.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.9 MB/s | 6.0 MB 00:01 2024-04-09T11:54:36.812 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:36.813 INFO:teuthology.orchestra.run.smithi029.stdout:Total 3.6 MB/s | 7.0 MB 00:01 2024-04-09T11:54:36.889 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:54:36.901 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:54:36.901 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:54:36.914 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:54 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:37.008 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:54:37.008 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:54:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:37.205 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:37.205 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:37.205 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.205 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:37.205 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.205 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:37.205 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.205 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:37.205 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.205 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:37.205 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.206 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:37.206 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.206 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:37.206 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.206 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:37.206 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.206 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:37.206 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.206 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:37.207 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.207 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:37.207 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.207 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:37.207 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.207 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:37.207 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.207 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:37.207 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.208 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:37.208 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.208 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:37.208 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.208 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:37.208 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.208 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:37.208 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.208 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:37.208 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:37.209 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:37.209 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:37.209 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:37.209 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:37.209 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:37.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:37.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:37.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:37.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:37.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.211 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:37.211 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.211 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:37.211 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.211 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:37.211 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.211 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:37.211 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.211 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:37.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.212 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:37.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.212 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:37.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.212 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:37.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.212 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:37.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.213 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:37.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.214 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:37.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.214 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:37.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.215 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:37.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.215 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:37.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.216 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:37.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.216 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:37.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.217 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:37.217 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rbd-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:37.275 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:37.276 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-04-09T11:54:37.276 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:37.328 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:54:37.383 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-fuse 2024-04-09T11:54:37.525 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-09T11:54:37.580 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-09T11:54:37.985 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:55 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:38.146 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-09T11:54:38.247 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-09T11:54:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.276 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:38.277 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:38.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:38.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:38.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.282 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.282 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.282 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.282 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:38.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.283 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:38.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:38.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.285 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:38.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.285 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:38.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.286 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.286 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.286 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:38.316 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-09T11:54:38.345 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:38.346 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:38.346 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-04-09T11:54:38.346 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:38.346 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:54:38.347 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 87 k 2024-04-09T11:54:38.347 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:38.347 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:54:38.347 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:38.347 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:54:38.347 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:38.347 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 87 k 2024-04-09T11:54:38.347 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 227 k 2024-04-09T11:54:38.347 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:54:38.355 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 6/6 2024-04-09T11:54:38.674 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-fuse-18.2.2-1187.gd540ebac.el9.x86_64.rpm 265 kB/s | 87 kB 00:00 2024-04-09T11:54:38.675 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:38.675 INFO:teuthology.orchestra.run.smithi173.stdout:Total 264 kB/s | 87 kB 00:00 2024-04-09T11:54:38.675 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:54:38.682 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:54:38.682 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:54:38.742 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:54:38.743 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:54:38.885 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:54:38.972 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:39.379 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:39.418 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 6/6 2024-04-09T11:54:39.418 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 1/6 2024-04-09T11:54:39.418 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-09T11:54:39.418 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-09T11:54:39.418 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-09T11:54:39.418 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-09T11:54:39.703 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:39.703 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:39.703 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:54:39.703 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:54:39.704 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:39.704 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:39.752 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-09T11:54:39.753 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:39.753 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:54:39.753 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:39.753 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-09T11:54:39.753 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-09T11:54:39.753 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-09T11:54:39.753 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-09T11:54:39.753 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-09T11:54:39.753 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:39.753 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:39.984 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-mirror 2024-04-09T11:54:40.062 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-fuse 2024-04-09T11:54:40.596 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:58 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:40.674 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:44 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:40.889 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:40.889 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:40.890 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:40.890 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.890 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:40.890 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.890 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:40.890 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.890 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:40.890 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.890 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:40.890 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.890 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.891 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:40.892 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:40.893 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.894 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:40.895 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.896 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.897 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.898 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.959 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:40.960 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:40.960 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:54:40.960 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:40.960 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:54:40.960 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 3.0 M 2024-04-09T11:54:40.960 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:40.960 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:54:40.961 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:40.961 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:54:40.961 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:40.961 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 3.0 M 2024-04-09T11:54:40.961 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 12 M 2024-04-09T11:54:40.961 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:54:40.992 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:40.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.995 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:40.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.997 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.998 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:40.999 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.000 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:41.001 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.002 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.002 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.002 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:41.066 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:41.067 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:41.067 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-09T11:54:41.067 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:41.067 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:54:41.067 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 848 k 2024-04-09T11:54:41.068 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-09T11:54:41.068 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-09T11:54:41.068 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:41.068 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:54:41.068 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:41.068 INFO:teuthology.orchestra.run.smithi029.stdout:Install 2 Packages 2024-04-09T11:54:41.068 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:41.068 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 928 k 2024-04-09T11:54:41.068 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 2.7 M 2024-04-09T11:54:41.068 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:54:41.357 INFO:teuthology.orchestra.run.smithi029.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 647 kB/s | 80 kB 00:00 2024-04-09T11:54:41.552 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-mirror-18.2.2-1187.gd540ebac.el9.x86_64.rpm 5.1 MB/s | 3.0 MB 00:00 2024-04-09T11:54:41.552 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:41.553 INFO:teuthology.orchestra.run.smithi173.stdout:Total 5.0 MB/s | 3.0 MB 00:00 2024-04-09T11:54:41.553 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:54:41.562 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:54:41.562 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:54:41.637 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:54:41.637 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:54:42.061 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:54:42.119 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:42.144 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:54:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-09T11:54:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-09T11:54:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-09T11:54:42.144 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:42.174 INFO:teuthology.orchestra.run.smithi029.stdout:(2/2): ceph-fuse-18.2.2-1187.gd540ebac.el9.x86_ 901 kB/s | 848 kB 00:00 2024-04-09T11:54:42.174 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:42.175 INFO:teuthology.orchestra.run.smithi029.stdout:Total 838 kB/s | 928 kB 00:01 2024-04-09T11:54:42.188 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:54:42.212 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:54:42.212 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:54:42.295 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:54:42.296 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:54:42.488 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:54:42.637 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-09T11:54:42.721 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 2/2 2024-04-09T11:54:43.310 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:43.310 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:43.310 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:54:43.311 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:54:43.311 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:43.311 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:43.542 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 2/2 2024-04-09T11:54:43.542 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 1/2 2024-04-09T11:54:43.583 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-nbd 2024-04-09T11:54:43.868 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-09T11:54:43.868 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:43.868 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:54:43.868 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-09T11:54:43.868 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:43.868 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:44.196 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:02 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:44.226 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-volume 2024-04-09T11:54:44.485 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:44.485 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:44.485 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:44.485 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.485 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:44.486 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.486 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:44.486 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.486 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:44.486 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.486 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:44.487 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.487 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:44.487 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.487 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:44.487 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.487 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:44.487 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.488 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:44.488 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.488 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:44.488 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.488 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:44.488 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.488 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:44.488 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.488 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:44.489 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.489 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:44.489 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.489 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:44.489 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.489 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:44.490 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.490 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:44.490 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.490 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:44.490 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.490 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:44.491 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.491 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:44.491 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.491 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:44.491 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.491 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:44.492 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:44.492 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:44.492 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:44.492 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:44.492 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.492 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:44.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:44.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:44.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:44.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:44.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.493 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:44.493 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:44.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:44.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:44.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:44.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:44.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:44.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:44.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:44.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:44.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:44.553 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:44.554 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:44.554 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-04-09T11:54:44.555 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:44.555 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:54:44.555 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 172 k 2024-04-09T11:54:44.555 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:44.555 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:54:44.555 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:44.555 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:54:44.555 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:44.555 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 172 k 2024-04-09T11:54:44.556 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 494 k 2024-04-09T11:54:44.556 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:54:44.857 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:48 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:45.005 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-nbd-18.2.2-1187.gd540ebac.el9.x86_64.rpm 383 kB/s | 172 kB 00:00 2024-04-09T11:54:45.005 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:45.005 INFO:teuthology.orchestra.run.smithi173.stdout:Total 382 kB/s | 172 kB 00:00 2024-04-09T11:54:45.006 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:54:45.014 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:54:45.014 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:54:45.074 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:54:45.074 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:54:45.161 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:45.161 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:45.162 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:45.162 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.162 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:45.162 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.162 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:45.162 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.162 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:45.162 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.162 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:45.162 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.162 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.163 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:45.164 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.164 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:45.164 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.164 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:45.164 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.164 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:45.164 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.164 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:45.164 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.164 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:45.164 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.165 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:45.165 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.165 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:45.165 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.165 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:45.165 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.165 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:45.165 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.165 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:45.165 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.166 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:45.166 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.166 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:45.166 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.166 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:45.166 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.166 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:45.166 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.166 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:45.166 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.166 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.167 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:45.168 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.168 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:45.168 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.168 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:45.168 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.168 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:45.168 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.168 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.168 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.168 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:45.168 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:45.169 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.170 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.170 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.170 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.170 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:45.170 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.170 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.170 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.170 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.170 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:45.170 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.170 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.171 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.171 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.171 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:45.171 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.171 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.171 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.171 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.171 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:45.171 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.171 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.171 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.172 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:45.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:45.234 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:54:45.234 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:45.235 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:45.235 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-09T11:54:45.235 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:45.235 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:54:45.236 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:18.2.2-1187.gd540ebac.el9 ceph-noarch 264 k 2024-04-09T11:54:45.236 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-09T11:54:45.236 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-09T11:54:45.236 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:45.236 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:54:45.236 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:45.236 INFO:teuthology.orchestra.run.smithi029.stdout:Install 2 Packages 2024-04-09T11:54:45.236 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:45.237 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 341 k 2024-04-09T11:54:45.237 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 1.5 M 2024-04-09T11:54:45.237 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:54:45.378 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:45.649 INFO:teuthology.orchestra.run.smithi029.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 381 kB/s | 77 kB 00:00 2024-04-09T11:54:45.708 INFO:teuthology.orchestra.run.smithi029.stdout:(2/2): ceph-volume-18.2.2-1187.gd540ebac.el9.no 1.0 MB/s | 264 kB 00:00 2024-04-09T11:54:45.708 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:45.708 INFO:teuthology.orchestra.run.smithi029.stdout:Total 721 kB/s | 341 kB 00:00 2024-04-09T11:54:45.720 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:54:45.730 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:54:45.730 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:54:45.773 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:54:45.774 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:54:45.826 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:45.929 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:54:46.114 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-09T11:54:46.155 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:46.155 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:46.155 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:54:46.155 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:54:46.156 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:46.156 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:54:46.162 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:18.2.2-1187.gd540ebac.el9.noarch 2/2 2024-04-09T11:54:46.179 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:18.2.2-1187.gd540ebac.el9.noarch 2/2 2024-04-09T11:54:46.179 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:54:46.179 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-09T11:54:46.179 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:46.372 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-base-debuginfo 2024-04-09T11:54:47.016 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:05 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:54:47.022 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:18.2.2-1187.gd540ebac.el9.noarch 1/2 2024-04-09T11:54:47.317 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:54:47.317 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:54:47.317 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:54:47.317 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.317 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:54:47.317 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.317 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:54:47.317 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.317 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:54:47.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:54:47.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:54:47.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:54:47.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:54:47.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:47.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:47.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.325 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:47.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.325 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:47.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:47.386 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:54:47.387 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:47.387 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:54:47.387 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:47.387 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:54:47.387 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 67 M 2024-04-09T11:54:47.387 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-04-09T11:54:47.387 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 20 M 2024-04-09T11:54:47.388 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:47.388 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:54:47.388 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:54:47.388 INFO:teuthology.orchestra.run.smithi173.stdout:Install 2 Packages 2024-04-09T11:54:47.388 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:54:47.388 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 87 M 2024-04-09T11:54:47.389 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 482 M 2024-04-09T11:54:47.389 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:54:47.427 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-09T11:54:47.427 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:47.427 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:54:47.427 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:18.2.2-1187.gd540ebac.el9.noarch 2024-04-09T11:54:47.427 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-09T11:54:47.427 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:47.427 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:47.850 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librados-devel 2024-04-09T11:54:48.462 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:52 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:48.770 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:48.770 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:48.770 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:48.770 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:48.771 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:48.772 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.773 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.774 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:48.775 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.776 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.777 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.778 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.779 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:48.779 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.779 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.779 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.779 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.779 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:48.779 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.779 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.779 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.779 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:48.844 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:48.844 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:48.844 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T11:54:48.844 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:48.844 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:54:48.844 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 127 k 2024-04-09T11:54:48.844 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:48.845 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:54:48.845 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:48.845 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T11:54:48.845 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:48.845 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 127 k 2024-04-09T11:54:48.845 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 456 k 2024-04-09T11:54:48.845 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:54:49.274 INFO:teuthology.orchestra.run.smithi029.stdout:librados-devel-18.2.2-1187.gd540ebac.el9.x86_64 296 kB/s | 127 kB 00:00 2024-04-09T11:54:49.274 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:49.274 INFO:teuthology.orchestra.run.smithi029.stdout:Total 295 kB/s | 127 kB 00:00 2024-04-09T11:54:49.275 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:54:49.280 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:54:49.280 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:54:49.342 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:54:49.343 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:54:49.496 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:54:49.600 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:50.102 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:50.444 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:50.444 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:50.445 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:54:50.445 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:54:50.445 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:50.445 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:50.749 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install libcephfs2 2024-04-09T11:54:51.308 INFO:teuthology.orchestra.run.smithi173.stdout:(1/2): ceph-base-debuginfo-18.2.2-1187.gd540eba 17 MB/s | 67 MB 00:03 2024-04-09T11:54:51.359 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:55 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:51.663 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:51.663 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:51.663 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:51.663 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.663 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:51.663 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.663 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:51.663 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.664 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:51.665 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.666 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:51.666 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.666 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:51.666 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.666 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:51.666 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.666 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:51.666 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.666 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:51.666 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.667 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:51.667 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.667 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:51.667 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.667 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:51.667 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.667 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:51.667 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.667 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:51.667 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.667 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:51.668 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.668 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:51.668 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.668 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:51.668 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.668 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:51.668 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.668 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:51.668 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.669 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:51.669 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.669 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:51.669 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.669 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:51.669 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.669 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.670 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.671 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:51.672 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.672 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.672 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.672 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.672 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:51.672 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.672 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.672 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.672 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.672 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:51.672 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.673 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.673 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.673 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.673 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:51.673 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.673 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.673 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.673 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.673 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:51.674 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.674 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.674 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.674 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:51.674 INFO:teuthology.orchestra.run.smithi029.stdout:Package libcephfs2-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:51.736 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:51.737 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-04-09T11:54:51.737 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:51.831 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install libcephfs-devel 2024-04-09T11:54:52.425 INFO:teuthology.orchestra.run.smithi173.stdout:(2/2): ceph-debuginfo-18.2.2-1187.gd540ebac.el9 4.0 MB/s | 20 MB 00:05 2024-04-09T11:54:52.427 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:52.428 INFO:teuthology.orchestra.run.smithi173.stdout:Total 17 MB/s | 87 MB 00:05 2024-04-09T11:54:52.428 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:54:52.432 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:54:52.433 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:54:52.442 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:56 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:52.746 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:52.746 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:52.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:52.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:52.746 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.746 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:52.747 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:52.748 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:52.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:52.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:52.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:52.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:52.749 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.749 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.750 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.751 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.752 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.753 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.754 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.755 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:52.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.755 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:52.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.755 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:52.820 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:52.821 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T11:54:52.821 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:52.821 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:54:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 31 k 2024-04-09T11:54:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:52.821 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:54:52.821 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:54:52.821 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T11:54:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:52.822 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 31 k 2024-04-09T11:54:52.822 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 139 k 2024-04-09T11:54:52.822 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:54:52.993 INFO:teuthology.orchestra.run.smithi029.stdout:libcephfs-devel-18.2.2-1187.gd540ebac.el9.x86_6 181 kB/s | 31 kB 00:00 2024-04-09T11:54:52.994 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:54:52.994 INFO:teuthology.orchestra.run.smithi029.stdout:Total 180 kB/s | 31 kB 00:00 2024-04-09T11:54:52.994 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:54:52.996 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:54:52.997 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:54:52.997 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:54:52.998 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:54:53.032 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:54:53.033 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:54:53.130 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:54:53.252 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:53.658 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:53.957 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:54:53.958 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:53.958 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:54:53.958 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:54:53.958 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:54:53.958 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:54.194 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librados2 2024-04-09T11:54:54.809 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:58 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:55.113 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:55.113 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:55.113 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.114 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.115 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:55.116 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.117 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.118 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:55.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.121 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.123 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.123 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:55.123 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:55.188 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:55.189 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-04-09T11:54:55.189 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:55.280 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librbd1 2024-04-09T11:54:55.869 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:54:55.897 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:59 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:56.203 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:56.204 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:56.204 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:56.204 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.204 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:56.204 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.204 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:56.204 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.204 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:56.204 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.204 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:56.204 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.205 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:56.205 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.205 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:56.205 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.205 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:56.205 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.205 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:56.205 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.205 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:56.205 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.205 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:56.206 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.206 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:56.206 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.206 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:56.206 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.206 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:56.206 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.206 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:56.206 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.206 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:56.206 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:56.207 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.208 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:56.209 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:56.210 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.211 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:56.212 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.213 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.213 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.213 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.213 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:56.213 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.213 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.213 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.213 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:56.213 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:56.276 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:56.277 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-04-09T11:54:56.278 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:56.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rados 2024-04-09T11:54:56.970 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:00 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:57.273 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:57.273 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:57.273 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:57.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.273 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:57.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:57.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:57.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:57.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:57.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:57.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.276 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.277 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:57.278 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.278 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:57.278 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.278 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:57.278 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.278 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:57.278 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.278 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:57.278 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.278 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:57.278 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:57.279 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.280 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.281 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.281 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.281 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:57.281 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.281 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.281 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.281 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.281 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:57.282 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.282 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.282 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.282 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.282 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:57.282 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.282 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.282 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.282 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.282 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:57.282 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.283 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.284 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:57.284 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-rados-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:57.347 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:57.348 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-04-09T11:54:57.348 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:57.436 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rgw 2024-04-09T11:54:58.046 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:02 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:58.348 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:58.348 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:58.348 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:58.348 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.348 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:58.348 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.348 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:58.348 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:58.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:58.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:58.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:58.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.357 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:58.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:58.357 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-rgw-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:58.422 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:58.423 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-04-09T11:54:58.423 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:58.510 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-cephfs 2024-04-09T11:54:59.121 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:03 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:54:59.432 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:54:59.432 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:54:59.432 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:54:59.432 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.432 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:54:59.433 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.434 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:54:59.435 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.436 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:54:59.437 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.437 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:54:59.437 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.437 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:54:59.437 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.437 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:54:59.437 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.437 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:54:59.437 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.437 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:54:59.437 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.438 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:54:59.438 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.438 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:54:59.438 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.438 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:54:59.438 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.438 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:54:59.438 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.438 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.438 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.438 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:54:59.439 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.440 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.440 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.440 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.440 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:54:59.440 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.440 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.440 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.440 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.440 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:54:59.441 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.441 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.441 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.441 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.441 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:54:59.441 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.441 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.441 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.441 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.442 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:54:59.442 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.442 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.442 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.442 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.442 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:54:59.442 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.442 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.442 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.442 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:54:59.443 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-cephfs-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:54:59.505 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:54:59.506 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-04-09T11:54:59.507 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:54:59.592 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rbd 2024-04-09T11:55:00.200 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:04 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:55:00.508 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:55:00.509 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:55:00.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:55:00.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:55:00.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:55:00.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:55:00.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:55:00.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:55:00.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:55:00.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:55:00.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:55:00.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.517 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.518 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.518 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.518 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:55:00.518 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.518 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.518 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.518 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:55:00.518 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-rbd-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:55:00.583 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:55:00.584 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-04-09T11:55:00.584 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:55:00.667 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-fuse 2024-04-09T11:55:01.278 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:05 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:55:01.588 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:55:01.588 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:55:01.588 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:55:01.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:55:01.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:55:01.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:55:01.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.595 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.597 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:55:01.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.597 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:55:01.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:55:01.663 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:55:01.663 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:01.663 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-04-09T11:55:01.664 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:01.664 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:55:01.664 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 87 k 2024-04-09T11:55:01.664 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:01.664 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:55:01.664 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:01.664 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T11:55:01.664 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:01.664 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 87 k 2024-04-09T11:55:01.664 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 227 k 2024-04-09T11:55:01.664 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:55:02.001 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-fuse-18.2.2-1187.gd540ebac.el9.x86_64.rpm 257 kB/s | 87 kB 00:00 2024-04-09T11:55:02.002 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:55:02.002 INFO:teuthology.orchestra.run.smithi029.stdout:Total 256 kB/s | 87 kB 00:00 2024-04-09T11:55:02.002 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:55:02.010 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:55:02.010 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:55:02.071 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:55:02.072 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:55:02.219 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:55:02.336 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:55:02.808 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:55:02.890 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/2 2024-04-09T11:55:02.958 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 2/2 2024-04-09T11:55:03.123 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:55:03.123 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:03.123 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:55:03.123 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:55:03.123 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:03.123 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:55:03.435 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-mirror 2024-04-09T11:55:04.047 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:08 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:55:04.350 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:55:04.350 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:55:04.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:55:04.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:55:04.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:55:04.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:55:04.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:55:04.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:55:04.354 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:55:04.355 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.356 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.357 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.358 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.359 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.359 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:55:04.359 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.359 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.359 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.359 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:55:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:55:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:04.424 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T11:55:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:55:04.424 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 3.0 M 2024-04-09T11:55:04.424 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:55:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T11:55:04.424 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 3.0 M 2024-04-09T11:55:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 12 M 2024-04-09T11:55:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:55:06.296 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 2/2 2024-04-09T11:55:06.296 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/2 2024-04-09T11:55:06.387 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-mirror-18.2.2-1187.gd540ebac.el9.x86_64.rpm 1.5 MB/s | 3.0 MB 00:01 2024-04-09T11:55:06.388 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:55:06.388 INFO:teuthology.orchestra.run.smithi029.stdout:Total 1.5 MB/s | 3.0 MB 00:01 2024-04-09T11:55:06.389 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:55:06.400 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:55:06.400 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:55:06.484 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:55:06.484 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:55:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2/2 2024-04-09T11:55:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:55:06.573 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:55:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:55:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:55:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:55:06.573 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:55:06.825 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-common-debuginfo 2024-04-09T11:55:06.914 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:55:06.972 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:55:06.997 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:55:06.997 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-09T11:55:06.997 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-09T11:55:06.997 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-09T11:55:06.997 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-09T11:55:06.997 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:07.428 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:25 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:55:07.719 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:55:07.719 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:55:07.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:55:07.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:55:07.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:55:07.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:55:07.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:55:07.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.728 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:55:07.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.728 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:55:07.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:55:07.790 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 400 M 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 400 M 2024-04-09T11:55:07.791 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 1.6 G 2024-04-09T11:55:07.792 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:55:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:55:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:08.396 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:55:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:55:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:08.396 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:55:08.667 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-nbd 2024-04-09T11:55:09.285 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:13 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:55:09.588 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:55:09.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:55:09.592 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.593 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.594 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.595 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.596 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.597 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.598 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.598 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:55:09.662 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:55:09.663 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:09.663 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-04-09T11:55:09.663 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:09.663 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:55:09.663 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 172 k 2024-04-09T11:55:09.663 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:09.663 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:55:09.663 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:09.663 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T11:55:09.663 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:09.663 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 172 k 2024-04-09T11:55:09.664 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 494 k 2024-04-09T11:55:09.664 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:55:11.498 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-nbd-18.2.2-1187.gd540ebac.el9.x86_64.rpm 94 kB/s | 172 kB 00:01 2024-04-09T11:55:11.498 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:55:11.499 INFO:teuthology.orchestra.run.smithi029.stdout:Total 94 kB/s | 172 kB 00:01 2024-04-09T11:55:11.499 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:55:11.509 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:55:11.510 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:55:11.577 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:55:11.577 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:55:11.736 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:55:11.850 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:55:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:55:12.654 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T11:55:12.654 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:12.654 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:55:12.654 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:55:12.654 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:12.654 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:55:12.965 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-base-debuginfo 2024-04-09T11:55:13.593 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:17 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:55:13.900 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:55:13.901 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.902 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:55:13.902 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.902 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:55:13.902 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.902 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:55:13.902 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.902 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:55:13.902 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.902 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:55:13.902 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.903 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:55:13.904 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.905 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:55:13.906 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.906 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:55:13.906 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.906 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:55:13.906 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.907 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:55:13.907 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.907 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:55:13.907 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.907 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:55:13.907 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.907 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:55:13.907 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.908 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.908 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.908 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:55:13.908 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.908 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.908 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.908 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.908 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:55:13.909 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.909 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.909 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.909 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.909 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.909 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.909 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:55:13.910 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.910 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.910 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.910 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.910 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:55:13.910 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.910 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.910 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.911 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.911 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:55:13.911 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.911 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.911 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.911 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.911 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:55:13.911 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.911 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.911 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.912 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.912 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:55:13.912 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.912 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.912 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.912 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.912 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:55:13.912 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.913 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.913 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.913 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:55:13.975 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:55:13.975 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:13.976 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T11:55:13.976 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:13.976 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:55:13.976 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 67 M 2024-04-09T11:55:13.976 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-09T11:55:13.976 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 20 M 2024-04-09T11:55:13.976 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:13.976 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:55:13.976 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:13.976 INFO:teuthology.orchestra.run.smithi029.stdout:Install 2 Packages 2024-04-09T11:55:13.976 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:13.977 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 87 M 2024-04-09T11:55:13.977 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 482 M 2024-04-09T11:55:13.977 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:55:23.302 INFO:teuthology.orchestra.run.smithi029.stdout:(1/2): ceph-base-debuginfo-18.2.2-1187.gd540eba 7.2 MB/s | 67 MB 00:09 2024-04-09T11:55:27.552 INFO:teuthology.orchestra.run.smithi029.stdout:(2/2): ceph-debuginfo-18.2.2-1187.gd540ebac.el9 1.5 MB/s | 20 MB 00:13 2024-04-09T11:55:27.554 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:55:27.554 INFO:teuthology.orchestra.run.smithi029.stdout:Total 6.4 MB/s | 87 MB 00:13 2024-04-09T11:55:27.555 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:55:27.559 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:55:27.560 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:55:28.148 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:55:28.149 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:55:29.294 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-common-debuginfo-18.2.2-1187.gd540ebac.el9 19 MB/s | 400 MB 00:21 2024-04-09T11:55:29.295 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:55:29.295 INFO:teuthology.orchestra.run.smithi173.stdout:Total 19 MB/s | 400 MB 00:21 2024-04-09T11:55:29.296 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:55:29.300 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:55:29.300 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:55:31.155 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:55:31.694 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:55:31.694 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:55:38.572 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/2 2024-04-09T11:55:38.653 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 2/2 2024-04-09T11:55:45.444 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 2/2 2024-04-09T11:55:45.444 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/2 2024-04-09T11:55:45.752 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2/2 2024-04-09T11:55:45.752 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:45.752 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:55:45.752 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:55:45.752 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:55:45.752 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:45.752 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:55:46.055 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-common-debuginfo 2024-04-09T11:55:46.681 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:50 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:55:46.988 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:55:46.988 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:55:46.988 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:55:46.988 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.988 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:55:46.988 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.988 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:55:46.988 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.988 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.989 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.990 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:55:46.991 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.992 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:55:46.993 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.994 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.995 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.996 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.997 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:55:46.997 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.997 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.997 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:55:46.997 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:55:47.062 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:55:47.063 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:47.063 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T11:55:47.063 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:47.063 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:55:47.064 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 400 M 2024-04-09T11:55:47.064 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:47.064 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:55:47.064 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:55:47.064 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T11:55:47.064 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:55:47.064 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 400 M 2024-04-09T11:55:47.064 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 1.6 G 2024-04-09T11:55:47.064 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:56:12.148 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:56:12.256 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T11:56:18.983 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-common-debuginfo-18.2.2-1187.gd540ebac.el9 13 MB/s | 400 MB 00:31 2024-04-09T11:56:18.984 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:56:18.984 INFO:teuthology.orchestra.run.smithi029.stdout:Total 13 MB/s | 400 MB 00:31 2024-04-09T11:56:18.984 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:56:18.989 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:56:18.990 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:56:20.994 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T11:56:21.283 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T11:56:21.284 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:21.284 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:56:21.284 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:56:21.284 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:21.284 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:56:21.480 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:56:21.480 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:56:21.538 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2024-04-09T11:56:22.141 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:03:40 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:56:22.447 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:56:22.447 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:56:22.447 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:56:22.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.448 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:56:22.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.448 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:56:22.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.448 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:56:22.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.448 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:56:22.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.448 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:56:22.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.448 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:56:22.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:56:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:56:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:56:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:56:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:56:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:56:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:56:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:56:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:56:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:56:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:56:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:56:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:56:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:56:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:56:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:56:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:56:22.520 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 1.4 M 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 1.4 M 2024-04-09T11:56:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 6.2 M 2024-04-09T11:56:22.522 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:56:22.859 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-immutable-object-cache-debuginfo-18.2.2-11 4.2 MB/s | 1.4 MB 00:00 2024-04-09T11:56:22.860 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:56:22.861 INFO:teuthology.orchestra.run.smithi173.stdout:Total 4.2 MB/s | 1.4 MB 00:00 2024-04-09T11:56:22.861 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:56:22.864 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:56:22.864 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:56:22.907 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:56:22.908 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:56:23.166 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:56:23.258 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.2.2-1187. 1/1 2024-04-09T11:56:23.654 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:18.2.2-1187. 1/1 2024-04-09T11:56:23.929 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.2.2-1187. 1/1 2024-04-09T11:56:23.929 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:23.929 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:56:23.929 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:56:23.929 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:23.929 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:56:24.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw-debuginfo 2024-04-09T11:56:24.732 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:03:42 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:56:25.022 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:56:25.022 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:56:25.022 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:56:25.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:56:25.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:56:25.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:56:25.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:56:25.092 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:56:25.094 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:56:25.094 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:56:25.094 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:56:25.094 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:56:25.094 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 162 M 2024-04-09T11:56:25.094 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:25.094 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:56:25.095 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:56:25.095 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:56:25.095 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:25.095 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 162 M 2024-04-09T11:56:25.095 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 679 M 2024-04-09T11:56:25.095 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:56:33.628 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-radosgw-debuginfo-18.2.2-1187.gd540ebac.el 19 MB/s | 162 MB 00:08 2024-04-09T11:56:33.629 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:56:33.629 INFO:teuthology.orchestra.run.smithi173.stdout:Total 19 MB/s | 162 MB 00:08 2024-04-09T11:56:33.630 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:56:33.634 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:56:33.634 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:56:34.618 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:56:34.619 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:56:51.256 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:56:51.357 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x 1/1 2024-04-09T11:56:55.944 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x 1/1 2024-04-09T11:56:56.216 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x 1/1 2024-04-09T11:56:56.216 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:56.216 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:56:56.216 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:56:56.216 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:56.216 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:56:56.421 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-test-debuginfo 2024-04-09T11:56:57.028 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:04:15 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:56:57.317 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:56:57.317 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:56:57.317 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.319 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.320 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.322 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.326 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:56:57.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.326 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:56:57.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:56:57.389 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:56:57.389 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:56:57.390 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:56:57.390 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:56:57.390 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:56:57.390 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 582 M 2024-04-09T11:56:57.390 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:57.390 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:56:57.390 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:56:57.390 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:56:57.390 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:56:57.390 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 582 M 2024-04-09T11:56:57.390 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.6 G 2024-04-09T11:56:57.391 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:57:04.143 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:57:04.253 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T11:57:20.620 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T11:57:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T11:57:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:57:20.923 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:57:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:57:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:57:20.924 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:57:21.201 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2024-04-09T11:57:21.809 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:04:25 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:57:22.117 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:57:22.117 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:57:22.117 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:57:22.117 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.117 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:57:22.117 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.117 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:57:22.117 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.118 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:57:22.118 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.118 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:57:22.118 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.118 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:57:22.118 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.118 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:57:22.118 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.118 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:57:22.118 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.119 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.120 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:57:22.121 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.122 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.123 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.124 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:57:22.125 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.126 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.127 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:57:22.189 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:57:22.190 INFO:teuthology.orchestra.run.smithi029.stdout:======================================================================================== 2024-04-09T11:57:22.190 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T11:57:22.190 INFO:teuthology.orchestra.run.smithi029.stdout:======================================================================================== 2024-04-09T11:57:22.190 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:57:22.190 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 1.4 M 2024-04-09T11:57:22.190 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:57:22.190 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:57:22.191 INFO:teuthology.orchestra.run.smithi029.stdout:======================================================================================== 2024-04-09T11:57:22.191 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T11:57:22.191 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:57:22.191 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 1.4 M 2024-04-09T11:57:22.191 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 6.2 M 2024-04-09T11:57:22.191 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:57:22.507 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-immutable-object-cache-debuginfo-18.2.2-11 4.5 MB/s | 1.4 MB 00:00 2024-04-09T11:57:22.507 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:57:22.508 INFO:teuthology.orchestra.run.smithi029.stdout:Total 4.5 MB/s | 1.4 MB 00:00 2024-04-09T11:57:22.508 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:57:22.511 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:57:22.511 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:57:22.554 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:57:22.555 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:57:22.601 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-test-debuginfo-18.2.2-1187.gd540ebac.el9.x 23 MB/s | 582 MB 00:25 2024-04-09T11:57:22.602 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:57:22.602 INFO:teuthology.orchestra.run.smithi173.stdout:Total 23 MB/s | 582 MB 00:25 2024-04-09T11:57:22.603 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:57:22.608 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:57:22.608 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:57:22.819 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:57:22.910 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.2.2-1187. 1/1 2024-04-09T11:57:23.409 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:18.2.2-1187. 1/1 2024-04-09T11:57:23.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.2.2-1187. 1/1 2024-04-09T11:57:23.696 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:57:23.696 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:57:23.696 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:57:23.696 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:57:23.696 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:57:23.920 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw-debuginfo 2024-04-09T11:57:24.529 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:04:28 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:57:24.833 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:57:24.833 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:57:24.833 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:57:24.833 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.833 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:57:24.833 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.833 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:57:24.833 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:57:24.834 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:57:24.835 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.836 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:57:24.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.837 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:57:24.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.837 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:57:24.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.837 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:57:24.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.837 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:57:24.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.837 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:57:24.837 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:57:24.838 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:57:24.839 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.840 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.841 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.842 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.843 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:57:24.907 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:57:24.908 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:57:24.908 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T11:57:24.908 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:57:24.908 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:57:24.908 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 162 M 2024-04-09T11:57:24.908 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:57:24.908 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:57:24.908 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:57:24.908 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T11:57:24.908 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:57:24.909 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 162 M 2024-04-09T11:57:24.909 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 679 M 2024-04-09T11:57:24.909 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:57:26.035 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:57:26.036 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:57:55.913 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-radosgw-debuginfo-18.2.2-1187.gd540ebac.el 5.2 MB/s | 162 MB 00:31 2024-04-09T11:57:55.913 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:57:55.914 INFO:teuthology.orchestra.run.smithi029.stdout:Total 5.2 MB/s | 162 MB 00:31 2024-04-09T11:57:55.914 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:57:55.918 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:57:55.918 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:57:56.948 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:57:56.948 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:58:14.505 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T11:58:14.607 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x 1/1 2024-04-09T11:58:23.557 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x 1/1 2024-04-09T11:58:23.867 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x 1/1 2024-04-09T11:58:23.867 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:58:23.867 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T11:58:23.867 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:58:23.867 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:58:23.867 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T11:58:24.107 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-test-debuginfo 2024-04-09T11:58:24.719 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:05:28 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T11:58:25.022 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T11:58:25.023 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T11:58:25.023 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T11:58:25.023 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.023 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T11:58:25.023 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.023 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T11:58:25.023 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.023 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T11:58:25.023 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.023 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T11:58:25.025 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.025 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T11:58:25.025 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.025 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T11:58:25.025 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.025 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T11:58:25.025 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.025 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T11:58:25.025 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.025 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T11:58:25.025 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.026 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T11:58:25.026 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.026 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T11:58:25.026 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.030 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T11:58:25.030 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.030 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T11:58:25.030 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.030 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T11:58:25.030 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.030 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T11:58:25.030 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.030 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T11:58:25.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.031 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T11:58:25.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.031 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T11:58:25.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.031 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T11:58:25.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.031 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T11:58:25.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.031 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T11:58:25.031 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.032 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T11:58:25.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.033 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T11:58:25.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.033 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:58:25.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.033 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:58:25.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:58:25.096 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T11:58:25.097 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:58:25.097 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T11:58:25.097 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:58:25.097 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T11:58:25.097 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 582 M 2024-04-09T11:58:25.097 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:58:25.098 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T11:58:25.098 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T11:58:25.098 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T11:58:25.098 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T11:58:25.098 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 582 M 2024-04-09T11:58:25.098 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 2.6 G 2024-04-09T11:58:25.098 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T11:58:27.766 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:58:27.942 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T11:58:36.674 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-test-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T11:58:36.959 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T11:58:36.959 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:58:36.959 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:58:36.960 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:58:36.960 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:58:36.960 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:58:37.256 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-base-debuginfo 2024-04-09T11:58:37.860 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:05:55 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:58:38.151 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:58:38.151 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:58:38.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:58:38.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:58:38.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:58:38.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:58:38.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:58:38.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.156 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.158 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:58:38.158 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.158 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.159 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:58:38.160 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.161 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:58:38.162 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-base-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T11:58:38.221 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:58:38.222 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-04-09T11:58:38.222 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:58:38.297 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-debuginfo 2024-04-09T11:58:38.900 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:05:56 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:58:39.191 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.192 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.193 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:58:39.194 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:58:39.195 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.196 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.197 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.198 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.199 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.200 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.201 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.201 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:58:39.262 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:58:39.263 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:58:39.263 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:58:39.263 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:58:39.263 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:58:39.263 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 19 M 2024-04-09T11:58:39.263 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:58:39.263 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:58:39.263 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:58:39.263 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:58:39.263 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:58:39.263 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 19 M 2024-04-09T11:58:39.264 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 101 M 2024-04-09T11:58:39.264 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:58:44.912 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-mgr-debuginfo-18.2.2-1187.gd540ebac.el9.x8 3.4 MB/s | 19 MB 00:05 2024-04-09T11:58:44.913 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:58:44.913 INFO:teuthology.orchestra.run.smithi173.stdout:Total 3.4 MB/s | 19 MB 00:05 2024-04-09T11:58:44.914 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:58:44.917 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:58:44.918 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:58:45.066 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:58:45.066 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:58:47.302 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:58:47.485 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T11:58:48.449 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T11:58:48.722 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T11:58:48.723 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:58:48.723 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:58:48.723 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:58:48.723 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:58:48.723 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:58:48.919 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mds-debuginfo 2024-04-09T11:58:49.524 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:06:07 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:58:49.816 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:58:49.816 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:58:49.816 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:58:49.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.816 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:58:49.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.816 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.817 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.826 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:58:49.885 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:58:49.885 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:58:49.886 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:58:49.886 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:58:49.886 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:58:49.886 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 47 M 2024-04-09T11:58:49.886 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:58:49.886 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:58:49.886 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:58:49.886 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:58:49.886 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:58:49.886 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 47 M 2024-04-09T11:58:49.886 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 171 M 2024-04-09T11:58:49.887 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:58:52.339 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-mds-debuginfo-18.2.2-1187.gd540ebac.el9.x8 19 MB/s | 47 MB 00:02 2024-04-09T11:58:52.340 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:58:52.340 INFO:teuthology.orchestra.run.smithi173.stdout:Total 19 MB/s | 47 MB 00:02 2024-04-09T11:58:52.341 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:58:52.345 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:58:52.345 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:58:52.660 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:58:52.660 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:58:55.103 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-test-debuginfo-18.2.2-1187.gd540ebac.el9.x 19 MB/s | 582 MB 00:30 2024-04-09T11:58:55.103 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:58:55.104 INFO:teuthology.orchestra.run.smithi029.stdout:Total 19 MB/s | 582 MB 00:30 2024-04-09T11:58:55.104 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T11:58:55.110 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T11:58:55.110 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T11:58:57.357 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:58:57.454 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T11:58:58.711 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T11:58:58.711 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T11:58:58.806 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T11:58:59.088 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T11:58:59.088 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:58:59.088 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:58:59.089 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:58:59.089 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:58:59.089 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:58:59.275 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mon-debuginfo 2024-04-09T11:58:59.880 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:06:17 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:59:00.169 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:59:00.169 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:59:00.169 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:59:00.169 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.169 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:59:00.169 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:59:00.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:59:00.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:59:00.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:59:00.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:59:00.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:59:00.238 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:59:00.239 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:59:00.239 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:59:00.239 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:59:00.239 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:59:00.239 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 98 M 2024-04-09T11:59:00.240 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:59:00.240 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:59:00.240 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:59:00.240 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:59:00.240 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:59:00.240 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 98 M 2024-04-09T11:59:00.240 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 450 M 2024-04-09T11:59:00.240 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:59:04.882 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-mon-debuginfo-18.2.2-1187.gd540ebac.el9.x8 21 MB/s | 98 MB 00:04 2024-04-09T11:59:04.883 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:59:04.883 INFO:teuthology.orchestra.run.smithi173.stdout:Total 21 MB/s | 98 MB 00:04 2024-04-09T11:59:04.884 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:59:04.888 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:59:04.888 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:59:05.497 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:59:05.498 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T11:59:15.807 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T11:59:15.912 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T11:59:18.956 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T11:59:19.244 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T11:59:19.244 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:59:19.244 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T11:59:19.244 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T11:59:19.244 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:59:19.244 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T11:59:19.444 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-osd-debuginfo 2024-04-09T11:59:20.047 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:06:38 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T11:59:20.338 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T11:59:20.339 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T11:59:20.339 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T11:59:20.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.339 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T11:59:20.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.339 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T11:59:20.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.339 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T11:59:20.339 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.339 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T11:59:20.340 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.341 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T11:59:20.342 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.343 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T11:59:20.343 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.343 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T11:59:20.343 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.343 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T11:59:20.343 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.343 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T11:59:20.343 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.343 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T11:59:20.344 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T11:59:20.345 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.346 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.346 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.346 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.346 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.346 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.346 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T11:59:20.346 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.346 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.346 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.346 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.346 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.347 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.348 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T11:59:20.407 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T11:59:20.408 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:59:20.408 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T11:59:20.408 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:59:20.408 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T11:59:20.409 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 286 M 2024-04-09T11:59:20.409 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:59:20.409 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T11:59:20.409 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T11:59:20.409 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T11:59:20.409 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T11:59:20.409 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 286 M 2024-04-09T11:59:20.409 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 1.2 G 2024-04-09T11:59:20.409 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T11:59:32.924 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-osd-debuginfo-18.2.2-1187.gd540ebac.el9.x8 23 MB/s | 286 MB 00:12 2024-04-09T11:59:32.925 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T11:59:32.925 INFO:teuthology.orchestra.run.smithi173.stdout:Total 23 MB/s | 286 MB 00:12 2024-04-09T11:59:32.925 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T11:59:32.930 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T11:59:32.930 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T11:59:34.637 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T11:59:34.638 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:00:03.500 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:00:03.988 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:00:04.093 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:04.900 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:00:11.790 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:12.070 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:12.070 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:12.070 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:00:12.070 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:12.070 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:12.071 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:00:12.289 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-fuse-debuginfo 2024-04-09T12:00:12.892 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:07:30 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:00:13.181 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:00:13.181 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:00:13.181 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:00:13.181 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.181 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:00:13.181 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.181 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:00:13.181 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.181 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:00:13.181 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.182 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:00:13.183 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.183 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:00:13.183 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.183 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:00:13.183 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.183 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:00:13.183 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.183 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:00:13.183 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.183 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:00:13.183 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.184 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.185 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:00:13.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:00:13.187 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:13.188 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.189 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.190 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:13.190 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.190 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.190 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.190 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.190 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:13.190 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.190 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.190 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.190 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:13.248 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:00:13.249 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:13.249 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:00:13.249 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:13.249 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:00:13.249 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 5.8 M 2024-04-09T12:00:13.249 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:13.249 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:00:13.249 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:13.249 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:00:13.249 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:13.250 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 5.8 M 2024-04-09T12:00:13.250 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 28 M 2024-04-09T12:00:13.250 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:00:13.964 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-fuse-debuginfo-18.2.2-1187.gd540ebac.el9.x 8.1 MB/s | 5.8 MB 00:00 2024-04-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi173.stdout:Total 8.1 MB/s | 5.8 MB 00:00 2024-04-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:00:13.969 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:00:13.969 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:00:14.037 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:00:14.037 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:00:14.768 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:00:14.878 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:00:15.396 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:00:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:00:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:15.668 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:00:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:15.668 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:00:15.851 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados-devel-debuginfo 2024-04-09T12:00:16.449 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:07:34 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:00:16.737 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:00:16.738 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:00:16.738 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:00:16.738 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.738 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:00:16.738 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.738 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:00:16.738 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.738 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:00:16.738 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.738 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:00:16.738 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.739 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:00:16.740 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.741 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:00:16.742 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.743 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.744 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.744 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:16.744 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.744 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.744 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.744 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.744 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:00:16.744 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.744 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.744 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.744 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.745 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.747 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.747 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:16.747 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.747 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.747 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.747 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:16.806 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:00:16.807 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:16.807 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:00:16.807 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:16.808 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:00:16.808 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 108 k 2024-04-09T12:00:16.808 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:16.808 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:00:16.808 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:16.808 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:00:16.808 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:16.808 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 108 k 2024-04-09T12:00:16.808 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 440 k 2024-04-09T12:00:16.808 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:00:17.134 INFO:teuthology.orchestra.run.smithi173.stdout:librados-devel-debuginfo-18.2.2-1187.gd540ebac. 333 kB/s | 108 kB 00:00 2024-04-09T12:00:17.135 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:17.135 INFO:teuthology.orchestra.run.smithi173.stdout:Total 331 kB/s | 108 kB 00:00 2024-04-09T12:00:17.135 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:00:17.138 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:00:17.138 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:00:17.175 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:00:17.175 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:00:17.295 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:00:17.399 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:00:17.784 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados-devel-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:00:18.068 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:00:18.068 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:00:18.068 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:18.068 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:00:18.266 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs2-debuginfo 2024-04-09T12:00:18.862 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:07:36 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:00:19.149 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.150 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:00:19.151 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:00:19.152 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.153 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.154 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:00:19.155 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.156 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.157 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.158 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.158 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:19.158 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.158 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.158 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.158 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:19.218 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 5.1 M 2024-04-09T12:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:19.220 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 5.1 M 2024-04-09T12:00:19.220 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 24 M 2024-04-09T12:00:19.220 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:00:19.703 INFO:teuthology.orchestra.run.smithi173.stdout:libcephfs2-debuginfo-18.2.2-1187.gd540ebac.el9. 11 MB/s | 5.1 MB 00:00 2024-04-09T12:00:19.704 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:19.704 INFO:teuthology.orchestra.run.smithi173.stdout:Total 11 MB/s | 5.1 MB 00:00 2024-04-09T12:00:19.705 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:00:19.708 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:00:19.708 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:00:19.772 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:00:19.772 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:00:20.411 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:00:20.551 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:00:20.734 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-test-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:00:21.026 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:00:21.026 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:21.027 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:00:21.027 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:21.027 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:21.027 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:00:21.066 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:00:21.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-base-debuginfo 2024-04-09T12:00:21.368 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:00:21.368 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:21.368 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:00:21.368 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:21.368 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:21.368 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:00:21.564 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados2-debuginfo 2024-04-09T12:00:21.963 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:07:25 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:00:22.160 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:07:40 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:00:22.268 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:00:22.269 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:00:22.269 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:00:22.269 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.269 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:00:22.269 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.269 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:00:22.269 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.269 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:00:22.269 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.269 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:00:22.269 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.270 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:00:22.271 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.272 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:00:22.273 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.274 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:22.275 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.276 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.277 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.278 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.278 INFO:teuthology.orchestra.run.smithi029.stdout:Package ceph-base-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 is already installed. 2024-04-09T12:00:22.343 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:00:22.345 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-04-09T12:00:22.345 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:00:22.428 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-debuginfo 2024-04-09T12:00:22.450 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:00:22.450 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:00:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:00:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:00:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:00:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:00:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:00:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:00:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:00:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:00:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:00:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:00:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:00:22.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:00:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:00:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:00:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:00:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:00:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:00:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:00:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:00:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:00:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:00:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:00:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.455 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:00:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:00:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:00:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:00:22.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:00:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:00:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:00:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:00:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:00:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.457 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:00:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:00:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:00:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:00:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:00:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.458 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:00:22.459 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.459 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.459 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.459 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:22.459 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.459 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.459 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.459 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.459 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:00:22.459 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.459 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.460 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.461 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.461 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.461 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:22.461 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.461 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.461 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.461 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.461 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:22.461 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.461 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.461 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.462 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.462 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:22.462 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.462 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.462 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.462 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.462 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:22.462 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.462 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.462 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.462 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:00:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:22.521 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:00:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:00:22.521 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 45 M 2024-04-09T12:00:22.521 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:22.522 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:00:22.522 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:22.522 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:00:22.522 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:22.522 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 45 M 2024-04-09T12:00:22.522 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 256 M 2024-04-09T12:00:22.522 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:00:23.041 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:07:27 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:00:23.344 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:00:23.344 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:00:23.344 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:00:23.344 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.344 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:00:23.344 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:00:23.345 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.346 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.347 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.348 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:00:23.349 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.350 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.351 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.352 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.353 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:23.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.353 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:23.418 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 19 M 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 19 M 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 101 M 2024-04-09T12:00:23.419 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:00:24.748 INFO:teuthology.orchestra.run.smithi173.stdout:librados2-debuginfo-18.2.2-1187.gd540ebac.el9.x 20 MB/s | 45 MB 00:02 2024-04-09T12:00:24.749 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:24.749 INFO:teuthology.orchestra.run.smithi173.stdout:Total 20 MB/s | 45 MB 00:02 2024-04-09T12:00:24.749 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:00:24.753 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:00:24.754 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:00:25.059 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:00:25.059 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:00:30.188 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:00:30.286 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:00:32.205 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:00:32.489 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:00:32.490 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:32.490 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:00:32.490 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:32.490 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:32.490 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:00:32.699 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librbd1-debuginfo 2024-04-09T12:00:32.918 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-mgr-debuginfo-18.2.2-1187.gd540ebac.el9.x8 2.0 MB/s | 19 MB 00:09 2024-04-09T12:00:32.919 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:32.919 INFO:teuthology.orchestra.run.smithi029.stdout:Total 2.0 MB/s | 19 MB 00:09 2024-04-09T12:00:32.920 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:00:32.924 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:00:32.924 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:00:33.080 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:00:33.080 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:00:33.296 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:07:51 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:00:33.586 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:00:33.586 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:00:33.586 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:00:33.586 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.586 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:00:33.586 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.587 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:00:33.588 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:00:33.589 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:00:33.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.591 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:00:33.591 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.591 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:00:33.591 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.591 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:00:33.591 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:00:33.592 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:00:33.592 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:00:33.592 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:00:33.592 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:00:33.592 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:00:33.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.593 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:33.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.593 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:00:33.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:33.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.596 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:33.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:33.655 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 50 M 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 50 M 2024-04-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 291 M 2024-04-09T12:00:33.657 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:00:35.474 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:00:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:librbd1-debuginfo-18.2.2-1187.gd540ebac.el9.x86 19 MB/s | 50 MB 00:02 2024-04-09T12:00:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:Total 19 MB/s | 50 MB 00:02 2024-04-09T12:00:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:00:36.347 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:00:36.347 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:00:36.689 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:00:36.690 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:00:37.282 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:37.576 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:37.576 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:37.576 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:00:37.576 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:37.576 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:37.576 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:00:37.810 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mds-debuginfo 2024-04-09T12:00:38.422 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:07:42 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:00:38.726 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:00:38.726 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:00:38.727 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.728 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:00:38.729 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.729 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:00:38.729 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.729 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:00:38.729 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.729 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:00:38.729 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.729 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:00:38.729 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.729 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:00:38.729 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.730 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:00:38.730 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.730 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:00:38.730 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.730 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:00:38.730 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.730 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:00:38.730 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.730 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:00:38.730 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.731 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:00:38.732 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.733 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.734 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.734 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.734 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:38.734 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.734 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.734 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.734 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.734 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:38.734 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.735 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:38.736 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.736 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.736 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.736 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.736 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:38.736 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.736 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.736 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.736 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:38.799 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:00:38.800 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:00:38.800 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:00:38.800 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:00:38.800 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:00:38.800 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 47 M 2024-04-09T12:00:38.800 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:38.800 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:00:38.800 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:00:38.800 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:00:38.800 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:38.801 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 47 M 2024-04-09T12:00:38.801 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 171 M 2024-04-09T12:00:38.801 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:00:41.442 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-mds-debuginfo-18.2.2-1187.gd540ebac.el9.x8 18 MB/s | 47 MB 00:02 2024-04-09T12:00:41.443 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:41.444 INFO:teuthology.orchestra.run.smithi029.stdout:Total 18 MB/s | 47 MB 00:02 2024-04-09T12:00:41.444 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:00:41.447 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:00:41.448 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:00:41.774 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:00:41.774 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:00:42.501 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:00:42.606 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librbd1-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:00:44.728 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:00:45.006 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:00:45.007 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:45.007 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:00:45.007 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:45.007 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:45.007 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:00:45.215 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-cephfs-debuginfo 2024-04-09T12:00:45.813 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:08:03 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:00:46.103 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:00:46.103 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:00:46.103 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:00:46.103 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.103 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:00:46.103 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.103 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:00:46.103 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.103 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:00:46.103 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:00:46.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:00:46.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:00:46.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.111 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:46.112 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.112 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.112 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.112 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:46.172 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 615 k 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 615 k 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.1 M 2024-04-09T12:00:46.173 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:00:46.628 INFO:teuthology.orchestra.run.smithi173.stdout:python3-cephfs-debuginfo-18.2.2-1187.gd540ebac. 1.3 MB/s | 615 kB 00:00 2024-04-09T12:00:46.629 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:46.629 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.3 MB/s | 615 kB 00:00 2024-04-09T12:00:46.629 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:00:46.634 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:00:46.634 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:00:46.671 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:00:46.672 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:00:46.745 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:00:46.839 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:00:46.860 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:46.935 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:00:47.314 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-cephfs-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:00:47.613 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:00:47.613 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:47.613 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:00:47.613 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:47.614 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:47.614 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:00:47.827 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rados-debuginfo 2024-04-09T12:00:48.426 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:08:06 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:00:48.716 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:00:48.716 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:00:48.716 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:00:48.716 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.716 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:00:48.716 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.716 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:00:48.716 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.716 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:00:48.717 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:00:48.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:00:48.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:48.785 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:00:48.786 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:48.786 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:00:48.786 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:48.787 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:00:48.787 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 769 k 2024-04-09T12:00:48.787 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:48.787 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:00:48.787 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:48.787 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:00:48.787 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:48.787 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 769 k 2024-04-09T12:00:48.787 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.7 M 2024-04-09T12:00:48.787 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:00:49.064 INFO:teuthology.orchestra.run.smithi173.stdout:python3-rados-debuginfo-18.2.2-1187.gd540ebac.e 2.7 MB/s | 769 kB 00:00 2024-04-09T12:00:49.065 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:49.065 INFO:teuthology.orchestra.run.smithi173.stdout:Total 2.7 MB/s | 769 kB 00:00 2024-04-09T12:00:49.065 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:00:49.068 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:00:49.068 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:00:49.107 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:00:49.108 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:00:49.287 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:00:49.387 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-debuginfo-2:18.2.2-1187.gd540ebac.el9. 1/1 2024-04-09T12:00:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:49.692 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:49.693 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:49.693 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:00:49.693 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:49.693 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:49.693 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:00:49.767 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-rados-debuginfo-2:18.2.2-1187.gd540ebac.el9. 1/1 2024-04-09T12:00:49.925 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mon-debuginfo 2024-04-09T12:00:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-debuginfo-2:18.2.2-1187.gd540ebac.el9. 1/1 2024-04-09T12:00:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:50.057 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:00:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:50.058 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:00:50.271 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rbd-debuginfo 2024-04-09T12:00:50.539 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:07:54 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:00:50.843 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:00:50.843 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:00:50.844 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:00:50.844 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.844 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:00:50.844 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.844 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:00:50.844 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.844 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:00:50.844 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.844 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:00:50.844 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.844 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:00:50.845 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.845 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:00:50.845 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.845 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:00:50.845 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.845 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:00:50.845 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.845 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:00:50.845 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.845 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:00:50.845 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.846 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:00:50.846 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.846 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:00:50.846 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.846 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:00:50.846 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.846 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:00:50.846 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.846 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:00:50.846 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.846 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:00:50.847 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.847 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:00:50.847 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.847 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:00:50.847 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.847 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:00:50.847 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.847 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:00:50.847 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.847 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:00:50.847 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.848 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:00:50.848 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.848 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:00:50.848 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.848 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:00:50.848 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.848 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:00:50.848 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.848 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:00:50.848 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.848 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:00:50.849 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.849 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:00:50.849 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.849 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:00:50.849 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.849 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:00:50.849 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.849 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:00:50.849 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.849 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:00:50.849 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.850 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:00:50.850 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.850 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:00:50.850 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.850 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:00:50.850 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.850 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:00:50.850 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.850 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.850 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.850 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.851 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.852 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.853 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.853 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.853 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:50.853 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.853 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.853 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.853 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.853 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:50.853 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.853 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.853 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.854 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.854 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:50.854 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.854 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.854 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.854 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:50.875 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:08:08 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:00:50.916 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:00:50.917 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:00:50.917 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:00:50.917 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:00:50.917 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:00:50.917 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 98 M 2024-04-09T12:00:50.917 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:50.918 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:00:50.918 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:00:50.918 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:00:50.918 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:00:50.918 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 98 M 2024-04-09T12:00:50.918 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 450 M 2024-04-09T12:00:50.918 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:00:51.164 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:00:51.165 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:00:51.165 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:00:51.165 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.165 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:00:51.165 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.165 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:00:51.165 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.165 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:00:51.165 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.165 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:00:51.165 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.166 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:00:51.166 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.166 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:00:51.166 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.166 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:00:51.166 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.166 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:00:51.166 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.166 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:00:51.166 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.166 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:00:51.167 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.167 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:00:51.167 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.167 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:00:51.167 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.167 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:00:51.167 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.167 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:00:51.167 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.167 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:00:51.167 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.168 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:00:51.168 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.168 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:00:51.168 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.168 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:00:51.168 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.168 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:00:51.168 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.168 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:00:51.168 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.168 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.169 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:00:51.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.170 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:00:51.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.170 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:00:51.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.170 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:00:51.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.170 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:00:51.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.170 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:00:51.170 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:00:51.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:00:51.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:00:51.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:00:51.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:51.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:51.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:51.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:51.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:51.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:51.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:51.232 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:00:51.233 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:51.233 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:00:51.234 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:51.234 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:00:51.234 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 1.1 M 2024-04-09T12:00:51.234 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:51.234 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:00:51.234 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:51.234 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:00:51.234 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:51.234 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 1.1 M 2024-04-09T12:00:51.234 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 4.3 M 2024-04-09T12:00:51.234 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:00:51.584 INFO:teuthology.orchestra.run.smithi173.stdout:python3-rbd-debuginfo-18.2.2-1187.gd540ebac.el9 3.2 MB/s | 1.1 MB 00:00 2024-04-09T12:00:51.584 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:51.584 INFO:teuthology.orchestra.run.smithi173.stdout:Total 3.2 MB/s | 1.1 MB 00:00 2024-04-09T12:00:51.585 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:00:51.588 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:00:51.588 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:00:51.629 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:00:51.630 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:00:51.851 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:00:51.949 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:00:52.338 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-rbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:00:52.622 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:00:52.622 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:52.622 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:00:52.622 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:52.622 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:52.622 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:00:52.859 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rgw-debuginfo 2024-04-09T12:00:53.461 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:08:11 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:00:53.753 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.754 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.755 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:00:53.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.757 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:00:53.758 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.759 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:00:53.759 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.759 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:00:53.759 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.759 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:00:53.759 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.759 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:00:53.759 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.759 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:00:53.759 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.759 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.760 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:53.761 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.762 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.763 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.763 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:53.763 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.763 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.763 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.763 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:53.824 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:00:53.825 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:53.825 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:00:53.825 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:53.825 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:00:53.825 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 337 k 2024-04-09T12:00:53.825 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:53.825 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:00:53.825 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:53.825 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:00:53.825 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:53.826 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 337 k 2024-04-09T12:00:53.826 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 1.0 M 2024-04-09T12:00:53.826 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:00:54.553 INFO:teuthology.orchestra.run.smithi173.stdout:python3-rgw-debuginfo-18.2.2-1187.gd540ebac.el9 464 kB/s | 337 kB 00:00 2024-04-09T12:00:54.554 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:54.554 INFO:teuthology.orchestra.run.smithi173.stdout:Total 463 kB/s | 337 kB 00:00 2024-04-09T12:00:54.555 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:00:54.558 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:00:54.559 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:00:54.597 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:00:54.598 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:00:54.738 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:00:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:00:55.231 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-rgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:00:55.522 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:00:55.522 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:55.522 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:00:55.522 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:55.522 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:55.523 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:00:55.723 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-fuse-debuginfo 2024-04-09T12:00:56.316 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-mon-debuginfo-18.2.2-1187.gd540ebac.el9.x8 18 MB/s | 98 MB 00:05 2024-04-09T12:00:56.316 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:56.317 INFO:teuthology.orchestra.run.smithi029.stdout:Total 18 MB/s | 98 MB 00:05 2024-04-09T12:00:56.317 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:00:56.321 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:00:56.322 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:00:56.324 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:08:14 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:00:56.616 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:00:56.616 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:00:56.616 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.617 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.618 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.619 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:00:56.620 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.620 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:00:56.620 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.620 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:00:56.620 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.620 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:00:56.620 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.620 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:00:56.620 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.620 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:00:56.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:00:56.622 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:00:56.622 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:00:56.622 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:00:56.622 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:00:56.622 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.626 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:56.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:56.685 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:00:56.686 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:56.686 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:00:56.686 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:56.686 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:00:56.686 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 511 k 2024-04-09T12:00:56.686 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:56.686 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:00:56.687 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:56.687 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:00:56.687 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:56.687 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 511 k 2024-04-09T12:00:56.687 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.5 M 2024-04-09T12:00:56.687 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:00:56.960 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:00:56.961 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:00:57.098 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-fuse-debuginfo-18.2.2-1187.gd540ebac.el9.x8 1.2 MB/s | 511 kB 00:00 2024-04-09T12:00:57.098 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:00:57.098 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.2 MB/s | 511 kB 00:00 2024-04-09T12:00:57.099 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:00:57.102 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:00:57.102 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:00:57.141 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:00:57.142 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:00:57.300 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:00:57.396 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:57.792 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:58.071 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:00:58.071 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:58.071 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:00:58.071 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:00:58.071 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:58.072 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:00:58.280 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-mirror-debuginfo 2024-04-09T12:00:58.882 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:08:16 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:00:59.170 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:00:59.171 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:00:59.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:00:59.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:00:59.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:00:59.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:00:59.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.171 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:00:59.171 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:00:59.172 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:00:59.173 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.174 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:00:59.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:00:59.239 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:00:59.240 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:59.240 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:00:59.240 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:59.240 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:00:59.240 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 50 M 2024-04-09T12:00:59.240 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:59.240 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:00:59.240 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:00:59.240 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:00:59.240 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:00:59.241 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 50 M 2024-04-09T12:00:59.241 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 281 M 2024-04-09T12:00:59.241 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:01:02.326 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-mirror-debuginfo-18.2.2-1187.gd540ebac.el9. 16 MB/s | 50 MB 00:03 2024-04-09T12:01:02.327 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:01:02.328 INFO:teuthology.orchestra.run.smithi173.stdout:Total 16 MB/s | 50 MB 00:03 2024-04-09T12:01:02.328 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:01:02.332 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:01:02.332 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:01:02.661 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:01:02.662 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:01:07.844 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:01:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:01:08.334 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:01:08.431 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:01:10.434 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:01:10.725 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:01:10.725 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:01:10.725 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:01:10.725 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:01:10.725 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:01:10.726 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:01:10.936 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-nbd-debuginfo 2024-04-09T12:01:11.537 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:08:29 ago on Tue 09 Apr 2024 11:52:42 AM UTC. 2024-04-09T12:01:11.829 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-04-09T12:01:11.830 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:01:11.830 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-04-09T12:01:11.830 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.830 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-04-09T12:01:11.830 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.830 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-04-09T12:01:11.830 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.830 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-04-09T12:01:11.830 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.830 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-04-09T12:01:11.831 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-04-09T12:01:11.832 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.833 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-04-09T12:01:11.834 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.834 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-04-09T12:01:11.834 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.834 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-04-09T12:01:11.834 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.834 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-04-09T12:01:11.834 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.834 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-04-09T12:01:11.834 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.834 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-04-09T12:01:11.834 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:01:11.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:01:11.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:01:11.899 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-04-09T12:01:11.900 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:01:11.900 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-04-09T12:01:11.900 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:01:11.900 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-04-09T12:01:11.900 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 1.3 M 2024-04-09T12:01:11.900 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:01:11.900 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-04-09T12:01:11.901 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-04-09T12:01:11.901 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-04-09T12:01:11.901 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:01:11.901 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 1.3 M 2024-04-09T12:01:11.901 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 5.5 M 2024-04-09T12:01:11.901 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-04-09T12:01:12.378 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-nbd-debuginfo-18.2.2-1187.gd540ebac.el9.x86 2.6 MB/s | 1.3 MB 00:00 2024-04-09T12:01:12.378 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:01:12.378 INFO:teuthology.orchestra.run.smithi173.stdout:Total 2.6 MB/s | 1.3 MB 00:00 2024-04-09T12:01:12.379 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-04-09T12:01:12.382 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-04-09T12:01:12.382 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-04-09T12:01:12.424 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-04-09T12:01:12.424 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-04-09T12:01:12.659 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-04-09T12:01:12.768 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:01:13.150 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-nbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:01:13.421 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:01:13.421 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:01:13.421 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-04-09T12:01:13.421 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:01:13.421 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:01:13.422 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-04-09T12:01:13.618 DEBUG:teuthology.parallel:result is None 2024-04-09T12:01:14.119 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:01:14.422 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:01:14.422 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:01:14.423 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:01:14.423 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:01:14.423 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:01:14.423 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:01:14.642 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-osd-debuginfo 2024-04-09T12:01:15.271 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:08:19 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:01:15.576 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:01:15.577 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:01:15.578 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:01:15.579 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.580 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.581 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.582 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.583 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:01:15.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.583 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:01:15.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.584 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:01:15.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:01:15.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.586 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:01:15.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.586 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:01:15.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.587 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.587 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:01:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:01:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:01:15.652 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:01:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:01:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:01:15.652 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 286 M 2024-04-09T12:01:15.652 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:01:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:01:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:01:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:01:15.653 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:01:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 286 M 2024-04-09T12:01:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 1.2 G 2024-04-09T12:01:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:01:30.240 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-osd-debuginfo-18.2.2-1187.gd540ebac.el9.x8 20 MB/s | 286 MB 00:14 2024-04-09T12:01:30.241 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:01:30.241 INFO:teuthology.orchestra.run.smithi029.stdout:Total 20 MB/s | 286 MB 00:14 2024-04-09T12:01:30.242 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:01:30.246 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:01:30.246 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:01:32.034 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:01:32.034 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:02:03.079 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:02:03.184 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:02:19.671 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:02:19.972 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:02:19.972 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:19.972 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:02:19.972 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:02:19.972 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:19.972 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:02:20.256 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-fuse-debuginfo 2024-04-09T12:02:20.871 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:09:24 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:02:21.175 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.177 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:02:21.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.178 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:02:21.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.178 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:02:21.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.178 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:02:21.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.178 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:02:21.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.178 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:02:21.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.179 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.180 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.181 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.182 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.183 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.184 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:02:21.247 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:02:21.248 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 5.8 M 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 5.8 M 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 28 M 2024-04-09T12:02:21.249 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:02:22.647 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-fuse-debuginfo-18.2.2-1187.gd540ebac.el9.x 4.1 MB/s | 5.8 MB 00:01 2024-04-09T12:02:22.648 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:02:22.649 INFO:teuthology.orchestra.run.smithi029.stdout:Total 4.1 MB/s | 5.8 MB 00:01 2024-04-09T12:02:22.649 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:02:22.654 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:02:22.654 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:02:22.729 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:02:22.729 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:02:23.485 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:02:23.599 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:02:24.416 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:02:24.723 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:02:24.723 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:24.723 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:02:24.723 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:02:24.724 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:24.724 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:02:24.956 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librados-devel-debuginfo 2024-04-09T12:02:25.566 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:09:29 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:02:25.869 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:02:25.869 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:02:25.869 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:02:25.869 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.869 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:02:25.870 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.870 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:02:25.870 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.870 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:02:25.870 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.870 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:02:25.870 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.870 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:02:25.871 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.871 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:02:25.871 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.871 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:02:25.871 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.871 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:02:25.871 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.871 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:02:25.871 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.871 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:02:25.871 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.872 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:02:25.872 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.872 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:02:25.872 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.872 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:02:25.872 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.872 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:02:25.872 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.872 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:02:25.872 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.873 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:02:25.873 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.873 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:02:25.873 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.873 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:02:25.873 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.873 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:02:25.873 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.873 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:02:25.874 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.874 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:02:25.874 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.874 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:02:25.874 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.874 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:02:25.874 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.874 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:02:25.874 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:02:25.875 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.876 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:02:25.876 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.876 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:02:25.876 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.876 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:02:25.876 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.876 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:02:25.876 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.876 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:02:25.876 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.876 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:02:25.877 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.877 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.877 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.877 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:02:25.877 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.877 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.877 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.877 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.877 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:02:25.877 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.877 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.878 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.878 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.878 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.878 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.878 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:02:25.878 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.878 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.878 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.878 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.879 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:02:25.879 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.879 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.879 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.879 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.879 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:02:25.879 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.879 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.879 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.880 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.880 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:02:25.880 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.880 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.880 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.880 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.880 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:02:25.880 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.880 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.880 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.880 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.881 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:02:25.881 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.881 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.881 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.881 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:02:25.940 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:02:25.941 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:25.941 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:02:25.941 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:25.942 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:02:25.942 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 108 k 2024-04-09T12:02:25.942 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:25.942 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:02:25.942 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:25.942 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:02:25.942 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:25.942 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 108 k 2024-04-09T12:02:25.942 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 440 k 2024-04-09T12:02:25.943 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:02:26.170 INFO:teuthology.orchestra.run.smithi029.stdout:librados-devel-debuginfo-18.2.2-1187.gd540ebac. 476 kB/s | 108 kB 00:00 2024-04-09T12:02:26.171 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:02:26.171 INFO:teuthology.orchestra.run.smithi029.stdout:Total 474 kB/s | 108 kB 00:00 2024-04-09T12:02:26.171 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:02:26.174 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:02:26.174 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:02:26.210 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:02:26.211 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:02:26.332 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:02:26.439 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:02:26.878 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados-devel-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:02:27.163 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:02:27.163 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:27.163 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:02:27.163 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:02:27.163 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:27.163 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:02:27.378 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install libcephfs2-debuginfo 2024-04-09T12:02:27.988 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:09:31 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:02:28.293 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:02:28.293 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:02:28.293 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:02:28.293 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.293 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:02:28.293 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.293 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:02:28.293 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.293 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:02:28.293 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.293 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.294 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:02:28.295 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.295 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:02:28.295 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.295 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:02:28.295 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.295 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:02:28.295 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.295 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:02:28.295 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.295 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:02:28.295 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.296 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:02:28.297 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.297 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:02:28.297 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.297 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:02:28.297 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.297 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:02:28.298 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.298 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:02:28.298 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.298 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:02:28.298 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.298 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:02:28.298 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.298 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:02:28.298 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.298 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:02:28.298 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.299 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.300 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.301 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.302 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:02:28.303 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.303 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.303 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.303 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:02:28.365 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:02:28.366 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:28.366 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:02:28.366 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:28.366 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:02:28.366 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 5.1 M 2024-04-09T12:02:28.367 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:28.367 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:02:28.367 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:28.367 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:02:28.367 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:28.367 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 5.1 M 2024-04-09T12:02:28.367 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 24 M 2024-04-09T12:02:28.367 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:02:29.069 INFO:teuthology.orchestra.run.smithi029.stdout:libcephfs2-debuginfo-18.2.2-1187.gd540ebac.el9. 7.3 MB/s | 5.1 MB 00:00 2024-04-09T12:02:29.070 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:02:29.070 INFO:teuthology.orchestra.run.smithi029.stdout:Total 7.3 MB/s | 5.1 MB 00:00 2024-04-09T12:02:29.071 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:02:29.075 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:02:29.075 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:02:29.143 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:02:29.143 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:02:29.823 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:02:29.921 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:02:30.642 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:02:30.937 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:02:30.937 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:30.937 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:02:30.938 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:02:30.938 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:30.938 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:02:31.159 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librados2-debuginfo 2024-04-09T12:02:31.770 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:09:35 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:02:32.073 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:02:32.074 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:02:32.074 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:02:32.074 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.074 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:02:32.074 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.074 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:02:32.074 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.074 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.075 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:02:32.076 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.076 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:02:32.076 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.076 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:02:32.076 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.076 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:02:32.076 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.076 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:02:32.076 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.076 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:02:32.077 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.077 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:02:32.077 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.077 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:02:32.077 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.077 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:02:32.077 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.077 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:02:32.077 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.078 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:02:32.078 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.078 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:02:32.078 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.078 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:02:32.078 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.078 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:02:32.078 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.078 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:02:32.078 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.078 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.079 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.080 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:02:32.081 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.081 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.081 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.081 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:02:32.081 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.081 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.081 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.081 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.081 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:02:32.081 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.081 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.082 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.083 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.083 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.083 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:02:32.083 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.083 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.083 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.083 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.083 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:02:32.083 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.083 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.083 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.084 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.084 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:02:32.084 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.084 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.084 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.084 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.084 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:02:32.084 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.084 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.084 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.084 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:02:32.146 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:02:32.172 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:32.172 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:02:32.172 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:32.172 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:02:32.172 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 45 M 2024-04-09T12:02:32.172 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:32.173 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:02:32.173 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:32.173 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:02:32.173 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:32.173 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 45 M 2024-04-09T12:02:32.173 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 256 M 2024-04-09T12:02:32.173 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:02:35.368 INFO:teuthology.orchestra.run.smithi029.stdout:librados2-debuginfo-18.2.2-1187.gd540ebac.el9.x 14 MB/s | 45 MB 00:03 2024-04-09T12:02:35.368 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:02:35.369 INFO:teuthology.orchestra.run.smithi029.stdout:Total 14 MB/s | 45 MB 00:03 2024-04-09T12:02:35.369 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:02:35.373 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:02:35.374 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:02:35.694 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:02:35.694 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:02:41.137 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:02:41.247 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:02:45.034 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:02:45.334 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_ 1/1 2024-04-09T12:02:45.334 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:45.334 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:02:45.334 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:02:45.334 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:45.334 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:02:45.578 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librbd1-debuginfo 2024-04-09T12:02:46.183 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:09:50 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:02:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:02:46.484 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:02:46.484 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:02:46.484 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.484 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:02:46.484 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.484 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:02:46.484 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.484 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:02:46.484 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.484 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.485 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:02:46.486 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.487 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:02:46.488 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:02:46.489 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.490 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.491 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.492 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.493 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.493 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:02:46.493 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.493 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.493 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.493 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:02:46.555 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 50 M 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 50 M 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 291 M 2024-04-09T12:02:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:02:49.383 INFO:teuthology.orchestra.run.smithi029.stdout:librbd1-debuginfo-18.2.2-1187.gd540ebac.el9.x86 18 MB/s | 50 MB 00:02 2024-04-09T12:02:49.384 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:02:49.384 INFO:teuthology.orchestra.run.smithi029.stdout:Total 18 MB/s | 50 MB 00:02 2024-04-09T12:02:49.385 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:02:49.389 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:02:49.389 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:02:49.743 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:02:49.743 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:02:55.858 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:02:55.961 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librbd1-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:03:00.167 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:03:00.474 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:03:00.474 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:00.474 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:03:00.475 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:03:00.475 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:00.475 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:03:00.779 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-cephfs-debuginfo 2024-04-09T12:03:01.386 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:10:05 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:03:01.688 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:03:01.688 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:03:01.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:03:01.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:03:01.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:03:01.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:03:01.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.693 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:03:01.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.693 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:03:01.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.693 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:03:01.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.693 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:03:01.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.693 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:03:01.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.693 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.694 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:03:01.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.696 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:03:01.697 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.698 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.698 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.698 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:03:01.761 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:03:01.763 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:01.763 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:03:01.763 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:01.763 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:03:01.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 615 k 2024-04-09T12:03:01.763 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:01.763 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:03:01.763 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:01.763 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:03:01.763 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:01.763 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 615 k 2024-04-09T12:03:01.764 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 2.1 M 2024-04-09T12:03:01.764 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:03:02.216 INFO:teuthology.orchestra.run.smithi029.stdout:python3-cephfs-debuginfo-18.2.2-1187.gd540ebac. 1.3 MB/s | 615 kB 00:00 2024-04-09T12:03:02.217 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:03:02.217 INFO:teuthology.orchestra.run.smithi029.stdout:Total 1.3 MB/s | 615 kB 00:00 2024-04-09T12:03:02.217 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:03:02.220 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:03:02.220 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:03:02.259 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:03:02.259 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:03:02.432 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:03:02.542 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:03:02.980 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: python3-cephfs-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:03:03.290 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-debuginfo-2:18.2.2-1187.gd540ebac.el9 1/1 2024-04-09T12:03:03.290 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:03.290 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:03:03.290 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:03:03.291 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:03.291 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:03:03.548 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rados-debuginfo 2024-04-09T12:03:04.155 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:10:08 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:03:04.465 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:03:04.466 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:03:04.466 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:03:04.466 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.466 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:03:04.466 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.466 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:03:04.466 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.466 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:03:04.466 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.466 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:03:04.466 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.467 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.468 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:03:04.469 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:03:04.470 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.471 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.472 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:03:04.473 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.474 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:03:04.538 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:03:04.539 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:04.539 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:03:04.539 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:04.539 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:03:04.539 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 769 k 2024-04-09T12:03:04.540 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:04.540 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:03:04.540 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:04.540 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:03:04.540 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:04.540 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 769 k 2024-04-09T12:03:04.540 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 2.7 M 2024-04-09T12:03:04.540 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:03:04.857 INFO:teuthology.orchestra.run.smithi029.stdout:python3-rados-debuginfo-18.2.2-1187.gd540ebac.e 2.4 MB/s | 769 kB 00:00 2024-04-09T12:03:04.858 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:03:04.858 INFO:teuthology.orchestra.run.smithi029.stdout:Total 2.4 MB/s | 769 kB 00:00 2024-04-09T12:03:04.858 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:03:04.862 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:03:04.862 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:03:04.903 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:03:04.903 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:03:05.092 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:03:05.210 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-debuginfo-2:18.2.2-1187.gd540ebac.el9. 1/1 2024-04-09T12:03:05.673 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: python3-rados-debuginfo-2:18.2.2-1187.gd540ebac.el9. 1/1 2024-04-09T12:03:05.992 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-debuginfo-2:18.2.2-1187.gd540ebac.el9. 1/1 2024-04-09T12:03:05.993 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:05.993 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:03:05.993 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:03:05.993 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:05.993 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:03:06.248 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rbd-debuginfo 2024-04-09T12:03:06.864 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:10:10 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:03:07.171 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:03:07.171 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:03:07.171 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:03:07.172 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:03:07.173 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:03:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.175 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.176 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.177 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.178 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.179 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.180 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:03:07.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.180 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:03:07.244 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:03:07.245 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:07.245 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:03:07.245 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:07.245 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:03:07.245 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 1.1 M 2024-04-09T12:03:07.245 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:07.246 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:03:07.246 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:07.246 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:03:07.246 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:07.246 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 1.1 M 2024-04-09T12:03:07.246 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 4.3 M 2024-04-09T12:03:07.246 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:03:07.731 INFO:teuthology.orchestra.run.smithi029.stdout:python3-rbd-debuginfo-18.2.2-1187.gd540ebac.el9 2.3 MB/s | 1.1 MB 00:00 2024-04-09T12:03:07.732 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:03:07.733 INFO:teuthology.orchestra.run.smithi029.stdout:Total 2.3 MB/s | 1.1 MB 00:00 2024-04-09T12:03:07.733 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:03:07.736 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:03:07.736 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:03:07.779 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:03:07.780 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:03:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:03:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:03:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: python3-rbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:03:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:03:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:08.866 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:03:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:03:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:08.866 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:03:09.118 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rgw-debuginfo 2024-04-09T12:03:09.731 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:10:13 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:03:10.034 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:03:10.034 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:03:10.034 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:03:10.034 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.035 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:03:10.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.035 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:03:10.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.035 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:03:10.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.035 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:03:10.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.035 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:03:10.035 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.035 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.036 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.037 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:03:10.038 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.038 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:03:10.038 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.038 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:03:10.038 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.038 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:03:10.038 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.038 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:03:10.038 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.038 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:03:10.038 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.039 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:03:10.040 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.041 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.042 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:03:10.042 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.042 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.042 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.042 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.042 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:03:10.042 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.042 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.042 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.042 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.042 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:03:10.043 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.043 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.043 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.043 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.043 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:03:10.043 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.043 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.043 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.043 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.043 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:03:10.043 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.044 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.044 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.044 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.044 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:03:10.044 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.044 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.044 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.044 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:03:10.106 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:03:10.107 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:10.107 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:03:10.107 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:10.107 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:03:10.108 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 337 k 2024-04-09T12:03:10.108 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:10.108 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:03:10.108 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:10.108 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:03:10.108 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:10.108 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 337 k 2024-04-09T12:03:10.108 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 1.0 M 2024-04-09T12:03:10.108 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:03:10.406 INFO:teuthology.orchestra.run.smithi029.stdout:python3-rgw-debuginfo-18.2.2-1187.gd540ebac.el9 1.1 MB/s | 337 kB 00:00 2024-04-09T12:03:10.406 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:03:10.407 INFO:teuthology.orchestra.run.smithi029.stdout:Total 1.1 MB/s | 337 kB 00:00 2024-04-09T12:03:10.407 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:03:10.410 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:03:10.410 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:03:10.449 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:03:10.450 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:03:10.595 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:03:10.707 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:03:11.103 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: python3-rgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:03:11.415 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x8 1/1 2024-04-09T12:03:11.415 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:11.415 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:03:11.415 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:03:11.415 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:11.415 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:03:11.650 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-fuse-debuginfo 2024-04-09T12:03:12.263 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:10:16 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:03:12.582 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:03:12.582 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.583 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.584 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.585 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:03:12.586 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.587 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.588 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.589 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.590 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:03:12.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.591 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:03:12.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.591 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:03:12.655 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:03:12.656 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:12.656 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:03:12.656 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:12.656 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:03:12.656 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 511 k 2024-04-09T12:03:12.656 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:12.656 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:03:12.657 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:12.657 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:03:12.657 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:12.657 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 511 k 2024-04-09T12:03:12.657 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 2.5 M 2024-04-09T12:03:12.657 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:03:12.921 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-fuse-debuginfo-18.2.2-1187.gd540ebac.el9.x8 1.9 MB/s | 511 kB 00:00 2024-04-09T12:03:12.922 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:03:12.922 INFO:teuthology.orchestra.run.smithi029.stdout:Total 1.9 MB/s | 511 kB 00:00 2024-04-09T12:03:12.922 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:03:12.926 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:03:12.926 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:03:12.964 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:03:12.965 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:03:13.127 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:03:13.223 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:03:13.642 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:03:13.949 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_6 1/1 2024-04-09T12:03:13.949 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:13.949 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:03:13.949 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:03:13.949 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:13.949 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:03:14.180 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-mirror-debuginfo 2024-04-09T12:03:14.788 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:10:18 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:03:15.095 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:03:15.095 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:03:15.095 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:03:15.095 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.095 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:03:15.095 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.095 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:03:15.095 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.096 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:03:15.097 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.098 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:03:15.099 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:03:15.100 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.101 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.102 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:03:15.103 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.104 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.104 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.104 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.104 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:03:15.104 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.104 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.104 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.104 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:03:15.168 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:03:15.169 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:15.169 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:03:15.169 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:15.169 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:03:15.169 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 50 M 2024-04-09T12:03:15.169 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:15.170 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:03:15.170 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:15.170 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:03:15.170 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:15.170 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 50 M 2024-04-09T12:03:15.170 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 281 M 2024-04-09T12:03:15.170 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:03:18.204 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-mirror-debuginfo-18.2.2-1187.gd540ebac.el9. 17 MB/s | 50 MB 00:03 2024-04-09T12:03:18.205 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:03:18.205 INFO:teuthology.orchestra.run.smithi029.stdout:Total 17 MB/s | 50 MB 00:03 2024-04-09T12:03:18.206 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:03:18.210 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:03:18.210 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:03:18.553 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:03:18.554 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:03:24.573 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:03:24.673 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:03:28.623 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:03:28.970 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86 1/1 2024-04-09T12:03:28.970 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:03:28.970 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:03:28.970 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:03:29.238 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-nbd-debuginfo 2024-04-09T12:03:29.846 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:10:33 ago on Tue 09 Apr 2024 11:52:56 AM UTC. 2024-04-09T12:03:30.150 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-09T12:03:30.151 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:03:30.151 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-09T12:03:30.151 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.151 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-09T12:03:30.151 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.151 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-09T12:03:30.151 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.151 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-09T12:03:30.151 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.151 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.152 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.153 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-09T12:03:30.154 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-09T12:03:30.155 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-09T12:03:30.156 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.157 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.158 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.159 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-09T12:03:30.224 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-09T12:03:30.224 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:30.224 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-04-09T12:03:30.224 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:30.225 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-09T12:03:30.225 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-debuginfo x86_64 2:18.2.2-1187.gd540ebac.el9 ceph 1.3 M 2024-04-09T12:03:30.225 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:30.225 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-09T12:03:30.225 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-09T12:03:30.225 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-04-09T12:03:30.225 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:30.225 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 1.3 M 2024-04-09T12:03:30.225 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 5.5 M 2024-04-09T12:03:30.225 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-09T12:03:30.545 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-nbd-debuginfo-18.2.2-1187.gd540ebac.el9.x86 3.9 MB/s | 1.3 MB 00:00 2024-04-09T12:03:30.545 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-09T12:03:30.546 INFO:teuthology.orchestra.run.smithi029.stdout:Total 3.9 MB/s | 1.3 MB 00:00 2024-04-09T12:03:30.546 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-09T12:03:30.549 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-09T12:03:30.549 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-09T12:03:30.593 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-09T12:03:30.593 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-09T12:03:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-09T12:03:30.930 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:03:31.448 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-nbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:03:31.756 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 1/1 2024-04-09T12:03:31.757 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:31.757 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-09T12:03:31.757 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-debuginfo-2:18.2.2-1187.gd540ebac.el9.x86_64 2024-04-09T12:03:31.757 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:31.757 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-09T12:03:31.998 DEBUG:teuthology.parallel:result is None 2024-04-09T12:03:31.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d540ebaca6b131a1dd560e7f69e024b133bbaa42 2024-04-09T12:03:32.215 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-09T12:03:32.235 INFO:teuthology.orchestra.run.smithi029.stdout:18.2.2-1187.gd540ebac.el9 2024-04-09T12:03:32.236 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1187.gd540ebac.el9 2024-04-09T12:03:32.236 INFO:teuthology.task.install:The correct ceph version 18.2.2-1187.gd540ebac is installed. 2024-04-09T12:03:32.238 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d540ebaca6b131a1dd560e7f69e024b133bbaa42 2024-04-09T12:03:32.455 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-09T12:03:32.481 INFO:teuthology.orchestra.run.smithi173.stdout:18.2.2-1187.gd540ebac.el9 2024-04-09T12:03:32.481 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1187.gd540ebac.el9 2024-04-09T12:03:32.481 INFO:teuthology.task.install:The correct ceph version 18.2.2-1187.gd540ebac is installed. 2024-04-09T12:03:32.486 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-09T12:03:32.486 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:03:32.487 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-09T12:03:32.514 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:03:32.514 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-09T12:03:32.554 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-09T12:03:32.554 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:03:32.554 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-04-09T12:03:32.582 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-09T12:03:32.650 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:03:32.650 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-04-09T12:03:32.681 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-09T12:03:32.751 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-09T12:03:32.751 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:03:32.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-09T12:03:32.778 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-09T12:03:32.845 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:03:32.845 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-09T12:03:32.875 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-09T12:03:32.945 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-09T12:03:32.945 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:03:32.946 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-04-09T12:03:32.973 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-09T12:03:33.041 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:03:33.041 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-04-09T12:03:33.071 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-09T12:03:33.140 INFO:teuthology.run_tasks:Running task ceph... 2024-04-09T12:03:33.220 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-09T12:03:33.220 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2024-04-09T12:03:33.223 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2024-04-09T12:03:33.251 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-09T12:03:33.251 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-09T12:03:33.289 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-09T12:03:33.320 INFO:tasks.ceph:Creating extra log directories... 2024-04-09T12:03:33.320 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-09T12:03:33.357 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-09T12:03:33.398 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-09T12:03:33.398 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-09T12:03:33.399 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481', 'branch': 'reef-release', 'description': 'rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7647481', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'reef-release'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'sha1': 'd540ebaca6b131a1dd560e7f69e024b133bbaa42', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'd540ebaca6b131a1dd560e7f69e024b133bbaa42'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef-release', 'sha1': 'd540ebaca6b131a1dd560e7f69e024b133bbaa42'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9468, 'sha1': 'd540ebaca6b131a1dd560e7f69e024b133bbaa42', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'reef-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'd540ebaca6b131a1dd560e7f69e024b133bbaa42', 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLd2rczFXtkBnExxc0wZ72DLZ2Oqx6t/y18wJm1SSm5q4Ov//fg3U+yoWqWxOembOfhrNsDo4XkL9WIYm6C+1s8=', 'smithi173.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMaUdtGkoG7u+mxCWB37j6LeAe+SEueeretaHrosLTHPOFvisXpgRARVqzn3jMm0wfpB3sEfQteZWNHSCb2ai7s='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-09_01:16:20', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-09T12:03:33.399 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-09T12:03:33.424 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-09T12:03:33.444 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2024-04-09T12:03:33.478 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2024-04-09T12:03:33.512 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:03:33.512 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2024-04-09T12:03:33.558 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-09T12:03:33.601 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2024-04-09T12:03:33.616 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-09T12:03:33.616 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-09T12:03:33.616 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-09T12:03:33.616 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-09T12:03:33.616 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-04-09T12:03:33.617 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-09 11:55:07.253962720 +0000 2024-04-09T12:03:33.617 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-09 11:51:51.052833448 +0000 2024-04-09T12:03:33.617 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-09 11:51:51.052833448 +0000 2024-04-09T12:03:33.617 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-04-09 11:51:51.052833448 +0000 2024-04-09T12:03:33.617 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-09T12:03:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-09T12:03:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-09T12:03:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 9.4829e-05 s, 5.4 MB/s 2024-04-09T12:03:33.683 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-09T12:03:33.739 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2024-04-09T12:03:33.794 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-09T12:03:33.794 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-09T12:03:33.794 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-04-09T12:03:33.794 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-09T12:03:33.794 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-04-09T12:03:33.794 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-09 11:55:07.253962720 +0000 2024-04-09T12:03:33.794 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-09 11:51:51.387827740 +0000 2024-04-09T12:03:33.794 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-09 11:51:51.387827740 +0000 2024-04-09T12:03:33.794 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-04-09 11:51:51.387827740 +0000 2024-04-09T12:03:33.795 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-09T12:03:33.859 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-09T12:03:33.859 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-09T12:03:33.859 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 7.6093e-05 s, 6.7 MB/s 2024-04-09T12:03:33.860 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-09T12:03:33.916 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2024-04-09T12:03:33.970 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-09T12:03:33.971 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-09T12:03:33.971 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-09T12:03:33.971 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-09T12:03:33.971 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-04-09T12:03:33.971 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-09 11:55:07.254962703 +0000 2024-04-09T12:03:33.971 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-09 11:51:51.717822118 +0000 2024-04-09T12:03:33.971 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-09 11:51:51.717822118 +0000 2024-04-09T12:03:33.971 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-04-09 11:51:51.717822118 +0000 2024-04-09T12:03:33.971 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-09T12:03:34.035 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-09T12:03:34.035 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-09T12:03:34.035 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 9.6413e-05 s, 5.3 MB/s 2024-04-09T12:03:34.036 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-09T12:03:34.094 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2024-04-09T12:03:34.148 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-09T12:03:34.149 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-09T12:03:34.149 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-09T12:03:34.149 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-09T12:03:34.149 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-04-09T12:03:34.149 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-09 11:55:07.254962703 +0000 2024-04-09T12:03:34.149 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-09 11:51:52.050816444 +0000 2024-04-09T12:03:34.149 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-09 11:51:52.050816444 +0000 2024-04-09T12:03:34.149 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-04-09 11:51:52.050816444 +0000 2024-04-09T12:03:34.149 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-09T12:03:34.213 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-09T12:03:34.213 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-09T12:03:34.213 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 9.4264e-05 s, 5.4 MB/s 2024-04-09T12:03:34.214 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-09T12:03:34.270 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-09T12:03:34.270 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:03:34.270 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-04-09T12:03:34.288 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-09T12:03:34.288 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-04-09T12:03:34.346 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-09T12:03:34.346 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-09T12:03:34.346 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-04-09T12:03:34.346 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-09T12:03:34.347 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-04-09T12:03:34.347 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-09 11:54:42.393894169 +0000 2024-04-09T12:03:34.347 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-09 11:51:38.416134020 +0000 2024-04-09T12:03:34.347 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-09 11:51:38.416134020 +0000 2024-04-09T12:03:34.347 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-04-09 11:51:38.416134020 +0000 2024-04-09T12:03:34.347 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-09T12:03:34.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-09T12:03:34.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-09T12:03:34.416 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00026825 s, 1.9 MB/s 2024-04-09T12:03:34.417 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-09T12:03:34.476 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-04-09T12:03:34.534 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-09T12:03:34.534 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-09T12:03:34.534 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-09T12:03:34.534 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-09T12:03:34.534 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-04-09T12:03:34.534 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-09 11:54:42.393894169 +0000 2024-04-09T12:03:34.534 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-09 11:51:38.770125847 +0000 2024-04-09T12:03:34.534 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-09 11:51:38.770125847 +0000 2024-04-09T12:03:34.535 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-04-09 11:51:38.770125847 +0000 2024-04-09T12:03:34.535 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-09T12:03:34.602 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-09T12:03:34.602 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-09T12:03:34.602 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000204948 s, 2.5 MB/s 2024-04-09T12:03:34.603 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-09T12:03:34.660 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-04-09T12:03:34.717 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-09T12:03:34.717 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-09T12:03:34.717 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-09T12:03:34.717 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-09T12:03:34.717 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-04-09T12:03:34.717 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-09 11:54:42.394894147 +0000 2024-04-09T12:03:34.717 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-09 11:51:39.277114144 +0000 2024-04-09T12:03:34.717 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-09 11:51:39.277114144 +0000 2024-04-09T12:03:34.717 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-04-09 11:51:39.277114144 +0000 2024-04-09T12:03:34.718 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-09T12:03:34.784 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-09T12:03:34.784 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-09T12:03:34.784 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000239407 s, 2.1 MB/s 2024-04-09T12:03:34.786 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-09T12:03:34.843 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-04-09T12:03:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-09T12:03:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-09T12:03:34.899 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-09T12:03:34.899 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-09T12:03:34.899 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-04-09T12:03:34.899 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-09 11:54:42.394894147 +0000 2024-04-09T12:03:34.899 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-09 11:51:39.620106226 +0000 2024-04-09T12:03:34.899 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-09 11:51:39.620106226 +0000 2024-04-09T12:03:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-04-09 11:51:39.620106226 +0000 2024-04-09T12:03:34.900 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-09T12:03:34.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-09T12:03:34.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-09T12:03:34.966 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000232576 s, 2.2 MB/s 2024-04-09T12:03:34.967 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-09T12:03:35.023 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-09T12:03:35.023 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-09T12:03:35.023 INFO:tasks.ceph:Generating config... 2024-04-09T12:03:35.024 INFO:tasks.ceph:[client] debug monc = 20 2024-04-09T12:03:35.024 INFO:tasks.ceph:[client] debug ms = 1 2024-04-09T12:03:35.024 INFO:tasks.ceph:[client] debug objecter = 20 2024-04-09T12:03:35.024 INFO:tasks.ceph:[client] debug rados = 20 2024-04-09T12:03:35.025 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-04-09T12:03:35.025 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-04-09T12:03:35.025 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-04-09T12:03:35.025 INFO:tasks.ceph:[global] ms type = async 2024-04-09T12:03:35.025 INFO:tasks.ceph:[global] osd heartbeat grace = 80 2024-04-09T12:03:35.025 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-09T12:03:35.025 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-09T12:03:35.025 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-09T12:03:35.025 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-09T12:03:35.025 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-09T12:03:35.025 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-04-09T12:03:35.025 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-04-09T12:03:35.025 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-04-09T12:03:35.026 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-04-09T12:03:35.026 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-04-09T12:03:35.026 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-04-09T12:03:35.026 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-04-09T12:03:35.026 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-04-09T12:03:35.026 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-09T12:03:35.026 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-09T12:03:35.026 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-09T12:03:35.026 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-09T12:03:35.026 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-09T12:03:35.026 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-04-09T12:03:35.026 INFO:tasks.ceph:[osd] debug bluefs = 1 2024-04-09T12:03:35.027 INFO:tasks.ceph:[osd] debug bluestore = 1 2024-04-09T12:03:35.027 INFO:tasks.ceph:[osd] debug monc = 20 2024-04-09T12:03:35.027 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-09T12:03:35.027 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] osd class default list = * 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] osd class load list = * 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] osd client watch timeout = 120 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-04-09T12:03:35.028 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-04-09T12:03:35.029 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-09T12:03:35.029 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-04-09T12:03:35.029 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-04-09T12:03:35.029 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-09T12:03:35.029 INFO:tasks.ceph:Setting up mon.a... 2024-04-09T12:03:35.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-09T12:03:35.089 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2024-04-09T12:03:35.092 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-09T12:03:35.139 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-09T12:03:35.167 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.c', '[v2:172.21.15.29:3301,v1:172.21.15.29:6790]'), ('mon.b', '172.21.15.173')] 2024-04-09T12:03:35.167 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],172.21.15.173', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-04-09T12:03:35.168 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:03:35.168 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-09T12:03:35.223 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --addv c '[v2:172.21.15.29:3301,v1:172.21.15.29:6790]' --add b 172.21.15.173 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:03:35.310 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:03:35.310 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:03:35.310 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = pacific 2024-04-09T12:03:35.310 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2024-04-09T12:03:35.310 INFO:teuthology.orchestra.run.smithi029.stdout:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:03:35.310 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:03:35.310 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:03:35.310 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 16 (pacific) 2024-04-09T12:03:35.310 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2024-04-09T12:03:35.310 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:03:35.311 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:03:35.311 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:03:35.311 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-09T12:03:35.312 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-09T12:03:35.326 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1673ebad-34a7-414e-b498-c4f5250b317b... 2024-04-09T12:03:35.327 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-09T12:03:35.369 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-09T12:03:35.416 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-04-09T12:03:35.416 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-09T12:03:35.417 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2024-04-09T12:03:35.418 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2024-04-09T12:03:35.419 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],172.21.15.173" 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: mon client directed command retry = 5 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: mon election default strategy = 1 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: ms inject socket failures = 5000 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: ms type = async 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: osd heartbeat grace = 80 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.420 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2024-04-09T12:03:35.421 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = bitmap 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore zero block detection = True 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: debug monc = 20 2024-04-09T12:03:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 10 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: osd class default list = * 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: osd class load list = * 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: osd client watch timeout = 120 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify cached snaps = True 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify missing on start = True 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: osd fast shutdown = False 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock override recovery settings = True 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2024-04-09T12:03:35.423 INFO:teuthology.orchestra.run.smithi029.stdout: osd op queue = debug_random 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: osd op queue cut off = debug_random 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: osd shutdown pgref assert = True 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-09T12:03:35.424 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-09T12:03:35.425 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: mon min osdmap epochs = 50 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd crush smoke test = False 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: mon osdmap full prune interval = 2 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: mon osdmap full prune min = 15 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: mon osdmap full prune txsize = 2 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: mon scrub interval = 300 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on pool no app = False 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: paxos service trim min = 10 2024-04-09T12:03:35.426 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout: debug monc = 20 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout: debug objecter = 20 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout: debug rados = 20 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2024-04-09T12:03:35.427 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2024-04-09T12:03:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2024-04-09T12:03:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2024-04-09T12:03:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],172.21.15.173" 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: mon client directed command retry = 5 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: mon election default strategy = 1 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: ms inject socket failures = 5000 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: ms type = async 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: osd heartbeat grace = 80 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2024-04-09T12:03:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2024-04-09T12:03:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2024-04-09T12:03:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2024-04-09T12:03:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2024-04-09T12:03:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2024-04-09T12:03:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: bdev async discard = True 2024-04-09T12:03:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: bdev enable discard = True 2024-04-09T12:03:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore allocator = bitmap 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore zero block detection = True 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 1 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 1 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: debug monc = 20 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 10 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2024-04-09T12:03:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: osd class default list = * 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: osd class load list = * 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: osd client watch timeout = 120 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify cached snaps = True 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify missing on start = True 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: osd fast shutdown = False 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock override recovery settings = True 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: osd op queue = debug_random 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: osd op queue cut off = debug_random 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: osd shutdown pgref assert = True 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-09T12:03:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2024-04-09T12:03:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2024-04-09T12:03:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: mon min osdmap epochs = 50 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd crush smoke test = False 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: mon osdmap full prune interval = 2 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: mon osdmap full prune min = 15 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: mon osdmap full prune txsize = 2 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: mon scrub interval = 300 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on pool no app = False 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: paxos service trim min = 10 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2024-04-09T12:03:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-09T12:03:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-09T12:03:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: debug monc = 20 2024-04-09T12:03:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-09T12:03:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: debug objecter = 20 2024-04-09T12:03:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: debug rados = 20 2024-04-09T12:03:35.439 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2024-04-09T12:03:35.439 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2024-04-09T12:03:35.439 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2024-04-09T12:03:35.440 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-09T12:03:35.440 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-09T12:03:35.534 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-09T12:03:35.535 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:03:35.535 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-09T12:03:35.549 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:03:35.550 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-09T12:03:35.603 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2024-04-09T12:03:35.603 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:03:35.603 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-09T12:03:35.604 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-09T12:03:35.682 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:03:35.682 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:03:35.739 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2024-04-09T12:03:35.739 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:03:35.739 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-09T12:03:35.739 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-09T12:03:35.780 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:03:35.780 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:03:35.835 INFO:tasks.ceph:Setting up mon nodes... 2024-04-09T12:03:35.835 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-09T12:03:35.835 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-09T12:03:35.890 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-09T12:03:35.893 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-09T12:03:35.954 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-09T12:03:35.956 INFO:tasks.ceph:Setting up mds nodes... 2024-04-09T12:03:35.956 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-09T12:03:35.957 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-09T12:03:35.998 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-09T12:03:36.013 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-09T12:03:36.055 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-09T12:03:36.071 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-09T12:03:36.071 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-09T12:03:36.071 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-09T12:03:36.097 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-09T12:03:36.097 INFO:tasks.ceph:role: osd.0 2024-04-09T12:03:36.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-09T12:03:36.097 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-09T12:03:36.163 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-09T12:03:36.163 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-09T12:03:36.163 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-09T12:03:36.164 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-09T12:03:36.164 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-09T12:03:36.164 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-09T12:03:36.164 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-09T12:03:36.164 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-09T12:03:36.164 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-09T12:03:36.164 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-09T12:03:36.195 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-09T12:03:36.197 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-09T12:03:36.197 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-09T12:03:36.267 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-09T12:03:36.338 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-09T12:03:36.405 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-09T12:03:36.405 INFO:tasks.ceph:role: osd.1 2024-04-09T12:03:36.405 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-09T12:03:36.405 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-09T12:03:36.471 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-09T12:03:36.471 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-09T12:03:36.471 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-09T12:03:36.471 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-09T12:03:36.471 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-09T12:03:36.471 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-09T12:03:36.471 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-09T12:03:36.471 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-09T12:03:36.471 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-09T12:03:36.472 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-09T12:03:36.503 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-09T12:03:36.505 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-09T12:03:36.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-09T12:03:36.575 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-09T12:03:36.646 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-09T12:03:36.713 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-09T12:03:36.713 INFO:tasks.ceph:role: osd.2 2024-04-09T12:03:36.713 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-09T12:03:36.713 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-09T12:03:36.779 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-09T12:03:36.779 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-09T12:03:36.779 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-09T12:03:36.779 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-09T12:03:36.779 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-09T12:03:36.779 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-09T12:03:36.780 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-09T12:03:36.780 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-09T12:03:36.780 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-09T12:03:36.780 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-09T12:03:36.812 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-09T12:03:36.813 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-09T12:03:36.814 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-09T12:03:36.883 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-09T12:03:36.955 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-09T12:03:37.022 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-09T12:03:37.022 INFO:tasks.ceph:role: osd.3 2024-04-09T12:03:37.022 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-09T12:03:37.023 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-09T12:03:37.088 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-09T12:03:37.089 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-09T12:03:37.089 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-09T12:03:37.089 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-09T12:03:37.089 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-09T12:03:37.089 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-09T12:03:37.089 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-09T12:03:37.089 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-09T12:03:37.089 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-09T12:03:37.089 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-09T12:03:37.121 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-09T12:03:37.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-09T12:03:37.123 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-09T12:03:37.194 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-09T12:03:37.265 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:03:37.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:37.358+0000 7f7db3a48640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-09T12:03:37.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:37.358+0000 7f7db3a48640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-09T12:03:37.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:37.358+0000 7f7db3a48640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-09T12:03:37.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:37.358+0000 7f7db3a48640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-09T12:03:37.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:37.358+0000 7f7db3a48640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-09T12:03:37.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:37.359+0000 7f7db3a48640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-09T12:03:40.209 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-09T12:03:40.241 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:03:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:40.330+0000 7f911300d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-09T12:03:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:40.330+0000 7f911300d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-09T12:03:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:40.330+0000 7f911300d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-09T12:03:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:40.330+0000 7f911300d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-09T12:03:40.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:40.330+0000 7f911300d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-09T12:03:40.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:40.331+0000 7f911300d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-09T12:03:43.173 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-09T12:03:43.204 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:03:43.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:43.295+0000 7f5e5748b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-09T12:03:43.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:43.295+0000 7f5e5748b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-09T12:03:43.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:43.295+0000 7f5e5748b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-09T12:03:43.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:43.295+0000 7f5e5748b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-09T12:03:43.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:43.295+0000 7f5e5748b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-09T12:03:43.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:43.296+0000 7f5e5748b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-09T12:03:46.140 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-09T12:03:46.171 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:03:46.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:46.259+0000 7fb84cd24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-09T12:03:46.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:46.259+0000 7fb84cd24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-09T12:03:46.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:46.259+0000 7fb84cd24640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-09T12:03:46.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:46.259+0000 7fb84cd24640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-09T12:03:46.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:46.259+0000 7fb84cd24640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-09T12:03:46.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:03:46.260+0000 7fb84cd24640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-09T12:03:49.102 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-09T12:03:49.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-09T12:03:49.167 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-09T12:03:49.167 INFO:tasks.ceph:role: osd.4 2024-04-09T12:03:49.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-09T12:03:49.168 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-09T12:03:49.245 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-09T12:03:49.245 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-09T12:03:49.246 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-09T12:03:49.246 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-09T12:03:49.246 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-09T12:03:49.246 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-09T12:03:49.246 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-09T12:03:49.246 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-09T12:03:49.246 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-09T12:03:49.246 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-09T12:03:49.779 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-09T12:03:49.782 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-09T12:03:49.782 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-09T12:03:49.935 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-09T12:03:49.973 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-09T12:03:50.045 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-09T12:03:50.045 INFO:tasks.ceph:role: osd.5 2024-04-09T12:03:50.045 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-09T12:03:50.046 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-09T12:03:50.121 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-09T12:03:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-09T12:03:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-09T12:03:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-09T12:03:50.121 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-09T12:03:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-09T12:03:50.122 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-09T12:03:50.122 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-09T12:03:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-09T12:03:50.122 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-09T12:03:50.591 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-09T12:03:50.594 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-09T12:03:50.594 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-09T12:03:50.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-09T12:03:50.731 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-09T12:03:50.800 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-09T12:03:50.800 INFO:tasks.ceph:role: osd.6 2024-04-09T12:03:50.800 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-09T12:03:50.800 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-09T12:03:50.876 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-09T12:03:50.876 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-09T12:03:50.876 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-09T12:03:50.876 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-09T12:03:50.876 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-09T12:03:50.876 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-09T12:03:50.877 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-09T12:03:50.877 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-09T12:03:50.877 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-09T12:03:50.877 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-09T12:03:51.358 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-09T12:03:51.360 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-09T12:03:51.361 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-09T12:03:51.510 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-09T12:03:51.546 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-09T12:03:51.615 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-09T12:03:51.616 INFO:tasks.ceph:role: osd.7 2024-04-09T12:03:51.616 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-09T12:03:51.616 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-09T12:03:51.693 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-09T12:03:51.693 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-09T12:03:51.693 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-09T12:03:51.693 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-09T12:03:51.693 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-09T12:03:51.693 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-09T12:03:51.694 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-09T12:03:51.694 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-09T12:03:51.694 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-09T12:03:51.694 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-09T12:03:52.192 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-09T12:03:52.194 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-09T12:03:52.195 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-09T12:03:52.328 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-09T12:03:52.364 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:03:52.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:52.462+0000 7f8fbd3ac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-09T12:03:52.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:52.463+0000 7f8fbd3ac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-09T12:03:52.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:52.463+0000 7f8fbd3ac640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-09T12:03:52.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:52.463+0000 7f8fbd3ac640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-09T12:03:52.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:52.463+0000 7f8fbd3ac640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-09T12:03:52.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:52.463+0000 7f8fbd3ac640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-09T12:03:55.319 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-09T12:03:55.349 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:03:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:55.435+0000 7f0329415640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-09T12:03:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:55.436+0000 7f0329415640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-09T12:03:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:55.436+0000 7f0329415640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-09T12:03:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:55.436+0000 7f0329415640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-09T12:03:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:55.436+0000 7f0329415640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-09T12:03:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:55.436+0000 7f0329415640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-09T12:03:58.278 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-09T12:03:58.306 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:03:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:58.391+0000 7f5625848640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-09T12:03:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:58.391+0000 7f5625848640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-09T12:03:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:58.391+0000 7f5625848640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-09T12:03:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:58.391+0000 7f5625848640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-09T12:03:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:58.391+0000 7f5625848640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-09T12:03:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:03:58.392+0000 7f5625848640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-09T12:04:01.241 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-09T12:04:01.269 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:04:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:01.353+0000 7f607d71b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-09T12:04:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:01.353+0000 7f607d71b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-09T12:04:01.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:01.353+0000 7f607d71b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-09T12:04:01.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:01.353+0000 7f607d71b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-09T12:04:01.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:01.353+0000 7f607d71b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-09T12:04:01.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:01.354+0000 7f607d71b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-09T12:04:04.206 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-09T12:04:04.237 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-09T12:04:04.237 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:04:04.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-09T12:04:04.269 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:04:04.269 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-09T12:04:04.339 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:04:04.340 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-09T12:04:04.409 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:04:04.409 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-09T12:04:04.478 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:04:04.478 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-09T12:04:04.547 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:04:04.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-09T12:04:04.580 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:04:04.580 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-09T12:04:04.650 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:04:04.650 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-09T12:04:04.720 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:04:04.720 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-09T12:04:04.790 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:04:04.790 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-09T12:04:04.858 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:04:04.858 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-09T12:04:04.876 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:04:04.876 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-09T12:04:04.914 INFO:tasks.ceph:Adding keys to all mons... 2024-04-09T12:04:04.915 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-09T12:04:04.919 DEBUG:teuthology.orchestra.run.smithi173:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-09T12:04:04.958 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2024-04-09T12:04:04.958 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCXLhVmBgv9NBAAEDLGToopW6BN8t3XHU9Khw== 2024-04-09T12:04:04.958 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2024-04-09T12:04:04.958 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCZLhVm6Ax3FRAA/nAJIGVtf0R4pSzv8hN9SQ== 2024-04-09T12:04:04.958 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2024-04-09T12:04:04.958 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCcLhVmyivJExAAR5xeOoMqCvL7PlguReAFAA== 2024-04-09T12:04:04.958 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2024-04-09T12:04:04.958 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCfLhVma3anERAAFh2418G2W2AzZGHZ2giSPA== 2024-04-09T12:04:04.958 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCiLhVmgS+ADxAANKofRL/Z+3bp9pWCIuC2JA== 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCXLhVm20TEOBAA2g1reVnmdluCaaAhqoX98w== 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.4] 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCoLhVm8oioGxAA3XxKwrTewoK+JcPgmlfEyw== 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.5] 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCrLhVmA5oMGhAA60Eb1ExzHbvtU0mZkVy2iA== 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.6] 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCuLhVmwolpFxAA2wmS93/1jC5pML/FWxseuw== 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.7] 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCxLhVm/YEkFRAAHyiydejsss4bMemuqJQBgQ== 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-04-09T12:04:04.959 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCXLhVm/WRrOxAA/UL14kIzfJYZ3DUZyz4zNw== 2024-04-09T12:04:04.960 INFO:teuthology.orchestra.run.smithi029.stdout:[client.1] 2024-04-09T12:04:04.960 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCYLhVmsZk8AxAAJ4HL21Pbft+3W5yi+ClaNg== 2024-04-09T12:04:04.980 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.y] 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCXLhVmBgv9NBAAEDLGToopW6BN8t3XHU9Khw== 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.0] 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCZLhVm6Ax3FRAA/nAJIGVtf0R4pSzv8hN9SQ== 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.1] 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCcLhVmyivJExAAR5xeOoMqCvL7PlguReAFAA== 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.2] 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCfLhVma3anERAAFh2418G2W2AzZGHZ2giSPA== 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.3] 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCiLhVmgS+ADxAANKofRL/Z+3bp9pWCIuC2JA== 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.x] 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCXLhVm20TEOBAA2g1reVnmdluCaaAhqoX98w== 2024-04-09T12:04:04.981 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.4] 2024-04-09T12:04:04.982 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCoLhVm8oioGxAA3XxKwrTewoK+JcPgmlfEyw== 2024-04-09T12:04:04.982 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.5] 2024-04-09T12:04:04.982 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCrLhVmA5oMGhAA60Eb1ExzHbvtU0mZkVy2iA== 2024-04-09T12:04:04.982 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.6] 2024-04-09T12:04:04.982 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCuLhVmwolpFxAA2wmS93/1jC5pML/FWxseuw== 2024-04-09T12:04:04.982 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.7] 2024-04-09T12:04:04.982 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCxLhVm/YEkFRAAHyiydejsss4bMemuqJQBgQ== 2024-04-09T12:04:04.982 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-09T12:04:04.982 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCXLhVm/WRrOxAA/UL14kIzfJYZ3DUZyz4zNw== 2024-04-09T12:04:04.982 INFO:teuthology.orchestra.run.smithi173.stdout:[client.1] 2024-04-09T12:04:04.982 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCYLhVmsZk8AxAAJ4HL21Pbft+3W5yi+ClaNg== 2024-04-09T12:04:04.983 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-09T12:04:05.003 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-09T12:04:05.075 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.078 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.131 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.186 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.188 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.240 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.243 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.294 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-09T12:04:05.296 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-09T12:04:05.347 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.350 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.401 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.403 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.454 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.457 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.508 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.510 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-09T12:04:05.562 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-09T12:04:05.565 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-09T12:04:05.619 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-09T12:04:05.621 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-09T12:04:05.676 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-09T12:04:05.676 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-09T12:04:05.702 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-09T12:04:05.799 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-09T12:04:05.826 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-09T12:04:05.893 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-09T12:04:05.989 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-09T12:04:06.015 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-09T12:04:06.043 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-09T12:04:06.141 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-09T12:04:06.167 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:04:06.169 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-09T12:04:06.222 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-09T12:04:06.222 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-09T12:04:06.223 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-09T12:04:06.223 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-04-09T12:04:06.225 INFO:tasks.ceph.mon.a:Started 2024-04-09T12:04:06.225 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-09T12:04:06.225 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-09T12:04:06.225 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-04-09T12:04:06.228 INFO:tasks.ceph.mon.c:Started 2024-04-09T12:04:06.228 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-09T12:04:06.228 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-09T12:04:06.228 DEBUG:teuthology.orchestra.run.smithi173:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-04-09T12:04:06.265 INFO:tasks.ceph.mon.b:Started 2024-04-09T12:04:06.265 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-09T12:04:06.266 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-09T12:04:06.266 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-04-09T12:04:06.268 INFO:tasks.ceph.mgr.y:Started 2024-04-09T12:04:06.269 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-09T12:04:06.269 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-04-09T12:04:06.271 INFO:tasks.ceph.mgr.x:Started 2024-04-09T12:04:06.271 INFO:tasks.ceph:Setting crush tunables to default 2024-04-09T12:04:06.271 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.370+0000 7ff531a33640 10 monclient: get_monmap_and_config 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.370+0000 7ff531a33640 10 monclient: build_initial_monmap 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.370+0000 7ff531a33640 10 monclient: monmap: 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:04:06.371258+0000 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:04:06.371258+0000 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:06.373 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:06.374 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:06.374 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:06.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.371+0000 7ff531a33640 1 Processor -- start 2024-04-09T12:04:06.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.371+0000 7ff531a33640 1 -- start start 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.371+0000 7ff531a33640 10 monclient: init 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.371+0000 7ff531a33640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 10 monclient: _add_conns ranks=[0,3,4,1,2] 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff52c065b10 addr v1:172.21.15.29:6789/0 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff52c065ef0 0x7ff52c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 10 monclient(hunting): picked mon.noname-a con 0x7ff52c065ef0 addr v2:172.21.15.29:3300/0 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff52c0aed30 0x7ff52c1417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 10 monclient(hunting): picked mon.noname-c con 0x7ff52c0aed30 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c071740 con 0x7ff52c065b10 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff52affd640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff52c065b10 legacy=0x7ff52c13ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c141cf0 con 0x7ff52c065ef0 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c141f00 con 0x7ff52c0aed30 2024-04-09T12:04:06.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:06.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff531a33640 10 monclient(hunting): authenticate will time out at 1312.491121s 2024-04-09T12:04:06.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff52a7fc640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff52c065ef0 msgr2=0x7ff52c071bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T12:04:06.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff52a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff52c065ef0 0x7ff52c071bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T12:04:06.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff52b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7ff52c0aed30 msgr2=0x7ff52c1417b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T12:04:06.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.372+0000 7ff52b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff52c0aed30 0x7ff52c1417b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T12:04:06.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.573+0000 7ff52affd640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff52c065b10 legacy=0x7ff52c13ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T12:04:06.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.573+0000 7ff52a7fc640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff52c065ef0 msgr2=0x7ff52c071bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T12:04:06.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.573+0000 7ff52a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff52c065ef0 0x7ff52c071bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T12:04:06.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.573+0000 7ff52b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7ff52c0aed30 msgr2=0x7ff52c1417b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T12:04:06.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.573+0000 7ff52b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff52c0aed30 0x7ff52c1417b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T12:04:06.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.974+0000 7ff52affd640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff52c065b10 legacy=0x7ff52c13ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T12:04:06.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.974+0000 7ff52a7fc640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff52c065ef0 msgr2=0x7ff52c071bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T12:04:06.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.974+0000 7ff52a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff52c065ef0 0x7ff52c071bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T12:04:06.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.974+0000 7ff52b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7ff52c0aed30 msgr2=0x7ff52c1417b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T12:04:06.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:06.974+0000 7ff52b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff52c0aed30 0x7ff52c1417b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T12:04:07.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:07.775+0000 7ff52affd640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff52c065b10 legacy=0x7ff52c13ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T12:04:07.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:07.775+0000 7ff52a7fc640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff52c065ef0 msgr2=0x7ff52c071bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T12:04:07.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:07.775+0000 7ff52a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff52c065ef0 0x7ff52c071bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T12:04:07.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:07.775+0000 7ff52b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7ff52c0aed30 msgr2=0x7ff52c1417b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T12:04:07.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:07.775+0000 7ff52b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff52c0aed30 0x7ff52c1417b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 10 monclient(hunting): tick 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 10 monclient(hunting): _check_auth_tickets 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 1 monclient(hunting): continuing hunt 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7ff52c0aed30 msgr2=0x7ff52c1417b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff52c0aed30 0x7ff52c1417b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff52c065ef0 msgr2=0x7ff52c071bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff52c065ef0 0x7ff52c071bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff52c065b10 legacy=0x7ff52c13ec80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 10 monclient: _add_conns ranks=[2,1] 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff518003690 0x7ff518005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 10 monclient(hunting): picked mon.noname-b con 0x7ff518003690 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:09.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff5180061c0 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:09.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c13f390 con 0x7ff5180061c0 2024-04-09T12:04:09.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:09.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c141cf0 con 0x7ff518003690 2024-04-09T12:04:09.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff528ff9640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:09.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff52affd640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff518003690 msgr2=0x7ff518005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T12:04:09.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff52affd640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff518003690 0x7ff518005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T12:04:09.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.372+0000 7ff52a7fc640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7ff5180061c0 legacy=0x7ff518008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T12:04:09.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.573+0000 7ff52affd640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff518003690 msgr2=0x7ff518005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T12:04:09.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.573+0000 7ff52affd640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff518003690 0x7ff518005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T12:04:09.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.573+0000 7ff52a7fc640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7ff5180061c0 legacy=0x7ff518008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T12:04:09.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.974+0000 7ff52affd640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff518003690 msgr2=0x7ff518005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T12:04:09.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.974+0000 7ff52affd640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff518003690 0x7ff518005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T12:04:09.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:09.974+0000 7ff52a7fc640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7ff5180061c0 legacy=0x7ff518008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T12:04:10.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:10.775+0000 7ff52affd640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff518003690 msgr2=0x7ff518005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T12:04:10.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:10.775+0000 7ff52affd640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff518003690 0x7ff518005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T12:04:10.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:10.775+0000 7ff52a7fc640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7ff5180061c0 legacy=0x7ff518008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T12:04:12.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 10 monclient(hunting): tick 2024-04-09T12:04:12.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 10 monclient(hunting): _check_auth_tickets 2024-04-09T12:04:12.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 1 monclient(hunting): continuing hunt 2024-04-09T12:04:12.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T12:04:12.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff518003690 msgr2=0x7ff518005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:12.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff518003690 0x7ff518005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:12.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7ff5180061c0 legacy=0x7ff518008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:12.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2024-04-09T12:04:12.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff52b7fe640 1 -- reap_dead start 2024-04-09T12:04:12.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff518009f20 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff51800aab0 0x7ff518005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 10 monclient(hunting): picked mon.noname-b con 0x7ff51800aab0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff518008820 addr v1:172.21.15.29:6789/0 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c071740 con 0x7ff518008820 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c13f390 con 0x7ff518009f20 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c141cf0 con 0x7ff51800aab0 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff528ff9640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff52b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff518008820 legacy=0x7ff51800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff52a7fc640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff51800aab0 msgr2=0x7ff518005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff52a7fc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff51800aab0 0x7ff518005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T12:04:12.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.371+0000 7ff52affd640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7ff518009f20 legacy=0x7ff51800a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T12:04:12.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.572+0000 7ff52b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff518008820 legacy=0x7ff51800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T12:04:12.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.572+0000 7ff52a7fc640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff51800aab0 msgr2=0x7ff518005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T12:04:12.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.572+0000 7ff52a7fc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff51800aab0 0x7ff518005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T12:04:12.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.572+0000 7ff52affd640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7ff518009f20 legacy=0x7ff51800a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T12:04:12.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.973+0000 7ff52b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff518008820 legacy=0x7ff51800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T12:04:12.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.973+0000 7ff52a7fc640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff51800aab0 msgr2=0x7ff518005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T12:04:12.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.973+0000 7ff52a7fc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff51800aab0 0x7ff518005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T12:04:12.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:12.973+0000 7ff52affd640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7ff518009f20 legacy=0x7ff51800a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T12:04:13.228 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:00:06.856 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:04:13.537 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:00:07.165 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:04:13.726 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:00:07.354 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:04:13.728 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:00:07.356 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:04:13.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:13.774+0000 7ff52b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff518008820 legacy=0x7ff51800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T12:04:13.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:13.774+0000 7ff52a7fc640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff51800aab0 msgr2=0x7ff518005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T12:04:13.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:13.774+0000 7ff52a7fc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff51800aab0 0x7ff518005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T12:04:13.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:13.774+0000 7ff52affd640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7ff518009f20 legacy=0x7ff51800a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T12:04:14.051 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:00:07.678 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:04:14.053 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:00:07.681 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:04:15.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 10 monclient(hunting): tick 2024-04-09T12:04:15.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 10 monclient(hunting): _check_auth_tickets 2024-04-09T12:04:15.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 1 monclient(hunting): continuing hunt 2024-04-09T12:04:15.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T12:04:15.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff51800aab0 msgr2=0x7ff518005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:15.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff51800aab0 0x7ff518005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:15.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7ff518009f20 legacy=0x7ff51800a300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:15.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff518008820 legacy=0x7ff51800d150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:15.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 10 monclient: _add_conns ranks=[4,3] 2024-04-09T12:04:15.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:15.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 10 monclient(hunting): picked mon.noname-c con 0x7ff51800f9a0 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:15.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:15.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 10 monclient(hunting): picked mon.noname-a con 0x7ff518010480 addr v2:172.21.15.29:3300/0 2024-04-09T12:04:15.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:15.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c141cf0 con 0x7ff518010480 2024-04-09T12:04:15.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:15.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c141f00 con 0x7ff51800f9a0 2024-04-09T12:04:15.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.371+0000 7ff528ff9640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:15.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.400+0000 7ff52affd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.440+0000 7ff52affd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:58696/0 (socket says 172.21.15.29:58696) 2024-04-09T12:04:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.440+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 learned_addr learned my addr 172.21.15.29:0/3784102674 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:04:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.440+0000 7ff52affd640 10 monclient(hunting): get_auth_request con 0x7ff51800f9a0 auth_method 0 2024-04-09T12:04:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.440+0000 7ff52affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.440+0000 7ff52affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.440+0000 7ff52affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:15.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.468+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-09T12:04:15.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.468+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:15.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.468+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:15.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.468+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T12:04:15.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.569+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:15.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.575+0000 7ff52a7fc640 10 monclient(hunting): get_auth_request con 0x7ff518010480 auth_method 0 2024-04-09T12:04:15.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.575+0000 7ff52a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:15.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.575+0000 7ff52a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:15.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.575+0000 7ff52a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:15.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.601+0000 7ff52a7fc640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 msgr2=0x7ff51800e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-09T12:04:15.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.601+0000 7ff52a7fc640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 msgr2=0x7ff51800e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:15.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.601+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:15.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.601+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T12:04:15.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.669+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:15.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.669+0000 7ff52affd640 10 monclient(hunting): get_auth_request con 0x7ff51800f9a0 auth_method 0 2024-04-09T12:04:15.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.669+0000 7ff52affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:15.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.669+0000 7ff52affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:15.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.669+0000 7ff52affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:15.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.670+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-09T12:04:15.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.670+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:15.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.670+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:15.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.670+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T12:04:15.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.874+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:15.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.875+0000 7ff52a7fc640 10 monclient(hunting): get_auth_request con 0x7ff518010480 auth_method 0 2024-04-09T12:04:15.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.875+0000 7ff52a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:15.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.875+0000 7ff52a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:15.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.875+0000 7ff52a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:15.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.876+0000 7ff52a7fc640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 msgr2=0x7ff51800e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-09T12:04:15.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.876+0000 7ff52a7fc640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 msgr2=0x7ff51800e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:15.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.876+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:15.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:15.876+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T12:04:16.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.074+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:16.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.075+0000 7ff52affd640 10 monclient(hunting): get_auth_request con 0x7ff51800f9a0 auth_method 0 2024-04-09T12:04:16.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.075+0000 7ff52affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:16.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.075+0000 7ff52affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:16.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.075+0000 7ff52affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:16.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.077+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-09T12:04:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.077+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.077+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.077+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T12:04:16.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.480+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:16.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.481+0000 7ff52a7fc640 10 monclient(hunting): get_auth_request con 0x7ff518010480 auth_method 0 2024-04-09T12:04:16.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.481+0000 7ff52a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:16.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.481+0000 7ff52a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:16.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.481+0000 7ff52a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:16.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.481+0000 7ff52a7fc640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 msgr2=0x7ff51800e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-09T12:04:16.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.481+0000 7ff52a7fc640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 msgr2=0x7ff51800e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:16.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.481+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:16.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.481+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T12:04:16.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.880+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:16.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.880+0000 7ff52affd640 10 monclient(hunting): get_auth_request con 0x7ff51800f9a0 auth_method 0 2024-04-09T12:04:16.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.880+0000 7ff52affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:16.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.880+0000 7ff52affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:16.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.880+0000 7ff52affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:16.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.881+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-09T12:04:16.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.881+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:16.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.881+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:16.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:16.881+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T12:04:17.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:17.910+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:17.915+0000 7ff52a7fc640 10 monclient(hunting): get_auth_request con 0x7ff518010480 auth_method 0 2024-04-09T12:04:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:17.915+0000 7ff52a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:17.915+0000 7ff52a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:17.915+0000 7ff52a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:17.916+0000 7ff52a7fc640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 msgr2=0x7ff51800e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-09T12:04:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:17.916+0000 7ff52a7fc640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 msgr2=0x7ff51800e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:17.916+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:17.916+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T12:04:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 10 monclient(hunting): tick 2024-04-09T12:04:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 10 monclient(hunting): _check_auth_tickets 2024-04-09T12:04:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 1 monclient(hunting): continuing hunt 2024-04-09T12:04:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T12:04:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800f9a0 0x7ff51800fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 msgr2=0x7ff51800e870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff518010480 0x7ff51800e870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 10 monclient: _add_conns ranks=[4,0,3,2,1] 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff52b7fe640 1 -- 172.21.15.29:0/3784102674 reap_dead start 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 0x7ff518014c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 10 monclient(hunting): picked mon.noname-c con 0x7ff51800efe0 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff518008820 addr v1:172.21.15.29:6789/0 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 0x7ff51800fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 10 monclient(hunting): picked mon.noname-a con 0x7ff51800f460 addr v2:172.21.15.29:3300/0 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 1 -- 172.21.15.29:0/3784102674 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5180109b0 con 0x7ff518008820 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 1 -- 172.21.15.29:0/3784102674 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c141cf0 con 0x7ff51800f460 2024-04-09T12:04:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 1 -- 172.21.15.29:0/3784102674 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c141f00 con 0x7ff51800efe0 2024-04-09T12:04:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.371+0000 7ff528ff9640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.372+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 0x7ff518014c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.372+0000 7ff52affd640 10 monclient(hunting): get_auth_request con 0x7ff51800efe0 auth_method 0 2024-04-09T12:04:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.372+0000 7ff52affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.372+0000 7ff52affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.372+0000 7ff52affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.373+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 msgr2=0x7ff518014c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-09T12:04:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.373+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 msgr2=0x7ff518014c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.373+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 0x7ff518014c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:18.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.373+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 0x7ff518014c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T12:04:18.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.424+0000 7ff52b7fe640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 0x7ff51800fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:18.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.424+0000 7ff52b7fe640 10 monclient(hunting): get_auth_request con 0x7ff51800f460 auth_method 0 2024-04-09T12:04:18.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.424+0000 7ff52b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:18.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.424+0000 7ff52b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:18.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.424+0000 7ff52b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:18.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.425+0000 7ff52b7fe640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-09T12:04:18.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.425+0000 7ff52b7fe640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:18.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.425+0000 7ff52b7fe640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 0x7ff51800fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:18.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.425+0000 7ff52b7fe640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 0x7ff51800fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T12:04:18.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.714+0000 7ff52b7fe640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 0x7ff51800fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:18.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.725+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 0x7ff518014c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:18.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.739+0000 7ff52b7fe640 10 monclient(hunting): get_auth_request con 0x7ff51800f460 auth_method 0 2024-04-09T12:04:18.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.739+0000 7ff52b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:18.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.739+0000 7ff52b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:18.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.739+0000 7ff52b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:18.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.744+0000 7ff52b7fe640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-09T12:04:18.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.744+0000 7ff52b7fe640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:18.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.744+0000 7ff52b7fe640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 0x7ff51800fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:18.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.744+0000 7ff52b7fe640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 0x7ff51800fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T12:04:18.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.749+0000 7ff52affd640 10 monclient(hunting): get_auth_request con 0x7ff51800efe0 auth_method 0 2024-04-09T12:04:18.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.749+0000 7ff52affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:18.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.749+0000 7ff52affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:18.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.749+0000 7ff52affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:18.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.750+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 msgr2=0x7ff518014c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-09T12:04:18.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.750+0000 7ff52affd640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 msgr2=0x7ff518014c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:18.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.750+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 0x7ff518014c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:18.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:18.750+0000 7ff52affd640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 0x7ff518014c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T12:04:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.087+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939833263 0 0) 0x7ff5180109b0 con 0x7ff518008820 2024-04-09T12:04:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.087+0000 7ff529ffb640 10 monclient(hunting): _negotiate 2024-04-09T12:04:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.087+0000 7ff529ffb640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.087+0000 7ff529ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:19.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.087+0000 7ff529ffb640 10 monclient(hunting): my global_id is 4101 2024-04-09T12:04:19.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.087+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff514003520 con 0x7ff518008820 2024-04-09T12:04:19.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2010346124 0 0) 0x7ff514003520 con 0x7ff518008820 2024-04-09T12:04:19.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 msgr2=0x7ff518014c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:19.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.173:3300/0 conn(0x7ff51800efe0 0x7ff518014c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:19.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 msgr2=0x7ff51800fdb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 --2- 172.21.15.29:0/3784102674 >> v2:172.21.15.29:3300/0 conn(0x7ff51800f460 0x7ff51800fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 10 monclient: _finish_hunting 0 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 monclient: found mon.noname-a-legacy 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.29:6789/0 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c071740 con 0x7ff518008820 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 10 monclient: _finish_auth 0 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412254180 0 0) 0x7ff52000e310 con 0x7ff518008820 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff531a33640 5 monclient: authenticate success, global_id 4101 2024-04-09T12:04:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff531a33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-04-09T12:04:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 10 monclient: dump: 2024-04-09T12:04:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:04:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:19.152 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:19.152 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:19.152 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:19.152 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:19.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] but i'm connected to v1:172.21.15.29:6789/0, reconnecting 2024-04-09T12:04:19.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:19.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 >> v1:172.21.15.29:6789/0 conn(0x7ff518008820 legacy=0x7ff51800a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:19.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-09T12:04:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 --2- 172.21.15.29:0/3784102674 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff514003970 0x7ff514003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 10 monclient(hunting): picked mon.c con 0x7ff514003970 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 --2- 172.21.15.29:0/3784102674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5140047c0 0x7ff514004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 10 monclient(hunting): picked mon.b con 0x7ff5140047c0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.144+0000 7ff529ffb640 1 --2- 172.21.15.29:0/3784102674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff514005180 0x7ff51400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.145+0000 7ff529ffb640 10 monclient(hunting): picked mon.a con 0x7ff514005180 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.145+0000 7ff529ffb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.145+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c141cf0 con 0x7ff514005180 2024-04-09T12:04:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.145+0000 7ff529ffb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.145+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c141f00 con 0x7ff5140047c0 2024-04-09T12:04:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.145+0000 7ff529ffb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.145+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51400c0d0 con 0x7ff514003970 2024-04-09T12:04:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.145+0000 7ff529ffb640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.145+0000 7ff529ffb640 10 monclient(hunting): _finish_auth 0 2024-04-09T12:04:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.145+0000 7ff531a33640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.145+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5140047c0 0x7ff514004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.146+0000 7ff52a7fc640 10 monclient(hunting): get_auth_request con 0x7ff5140047c0 auth_method 0 2024-04-09T12:04:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.146+0000 7ff52a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.146+0000 7ff52a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.146+0000 7ff52a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:19.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.149+0000 7ff52a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:19.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.149+0000 7ff52a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:19.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.149+0000 7ff52a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-04-09T12:04:19.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 10 monclient(hunting): handle_auth_done global_id 4101 payload 293 2024-04-09T12:04:19.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 1 -- 172.21.15.29:0/3784102674 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff514003970 msgr2=0x7ff514003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:19.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff514003970 0x7ff514003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:19.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 1 -- 172.21.15.29:0/3784102674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff514005180 msgr2=0x7ff51400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:19.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff514005180 0x7ff51400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:19.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 10 monclient: _finish_hunting 0 2024-04-09T12:04:19.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 1 monclient: found mon.b 2024-04-09T12:04:19.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52b7fe640 1 -- 172.21.15.29:0/3784102674 reap_dead start 2024-04-09T12:04:19.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:19.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:19.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 1 -- 172.21.15.29:0/3784102674 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff514003520 con 0x7ff5140047c0 2024-04-09T12:04:19.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 10 monclient: _finish_auth 0 2024-04-09T12:04:19.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 10 monclient: _check_auth_tickets 2024-04-09T12:04:19.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.194+0000 7ff52a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:19.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.198+0000 7ff52a7fc640 1 --2- 172.21.15.29:0/3784102674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5140047c0 0x7ff514004c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff520006fd0 tx=0x7ff5140057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f922e634e00b213 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:19.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520036600 con 0x7ff5140047c0 2024-04-09T12:04:19.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff529ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:19.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff529ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:19.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff529ffb640 10 monclient: dump: 2024-04-09T12:04:19.238 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:04:19.238 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:19.238 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:19.238 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:19.238 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:19.239 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:19.239 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:19.239 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:19.239 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:19.239 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:19.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff520030070 con 0x7ff5140047c0 2024-04-09T12:04:19.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff531a33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:19.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff529ffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:19.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff531a33640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:19.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff531a33640 4 set_mon_vals no callback set 2024-04-09T12:04:19.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff529ffb640 1 -- 172.21.15.29:0/3784102674 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5200369c0 con 0x7ff5140047c0 2024-04-09T12:04:19.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff529ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:19.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff529ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:19.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.233+0000 7ff529ffb640 10 monclient: dump: 2024-04-09T12:04:19.240 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:04:19.240 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:19.240 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:19.240 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:19.240 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:19.240 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:19.240 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:19.240 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:19.241 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:19.241 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:19.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.234+0000 7ff531a33640 10 monclient: shutdown 2024-04-09T12:04:19.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.234+0000 7ff531a33640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:19.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.234+0000 7ff531a33640 1 -- 172.21.15.29:0/3784102674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5140047c0 msgr2=0x7ff514004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:19.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.234+0000 7ff531a33640 1 --2- 172.21.15.29:0/3784102674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5140047c0 0x7ff514004c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff520006fd0 tx=0x7ff5140057f0 comp rx=0 tx=0).stop 2024-04-09T12:04:19.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.234+0000 7ff531a33640 1 -- 172.21.15.29:0/3784102674 shutdown_connections 2024-04-09T12:04:19.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.234+0000 7ff531a33640 1 --2- 172.21.15.29:0/3784102674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5140047c0 0x7ff514004c40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:19.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.234+0000 7ff531a33640 1 -- 172.21.15.29:0/3784102674 >> 172.21.15.29:0/3784102674 conn(0x7ff52c0b3e70 msgr2=0x7ff52c0b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:19.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.234+0000 7ff531a33640 1 -- 172.21.15.29:0/3784102674 shutdown_connections 2024-04-09T12:04:19.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.234+0000 7ff531a33640 1 -- 172.21.15.29:0/3784102674 wait complete. 2024-04-09T12:04:19.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.235+0000 7ff531a33640 10 monclient: build_initial_monmap 2024-04-09T12:04:19.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.235+0000 7ff531a33640 10 monclient: monmap: 2024-04-09T12:04:19.244 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:04:19.244 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:19.244 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:04:19.244 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:04:19.244 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:19.244 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:19.244 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:19.244 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:19.245 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.235+0000 7ff531a33640 1 librados: starting msgr at 2024-04-09T12:04:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.235+0000 7ff531a33640 1 librados: starting objecter 2024-04-09T12:04:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.235+0000 7ff531a33640 1 Processor -- start 2024-04-09T12:04:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 1 -- start start 2024-04-09T12:04:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 1 librados: setting wanted keys 2024-04-09T12:04:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 1 librados: calling monclient init 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 10 monclient: init 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140047c0 0x7ff52c140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 10 monclient(hunting): picked mon.noname-a con 0x7ff5140047c0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff52c1cbb50 0x7ff52c06fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 10 monclient(hunting): picked mon.noname-b con 0x7ff52c1cbb50 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff52c1c9d60 0x7ff52c1ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 10 monclient(hunting): picked mon.noname-c con 0x7ff52c1c9d60 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c070230 con 0x7ff5140047c0 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c0704e0 con 0x7ff52c1cbb50 2024-04-09T12:04:19.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:19.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c1ca720 con 0x7ff52c1c9d60 2024-04-09T12:04:19.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:19.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.236+0000 7ff531a33640 10 monclient(hunting): authenticate will time out at 1325.356744s 2024-04-09T12:04:19.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.257+0000 7ff52affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140047c0 0x7ff52c140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:19.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.257+0000 7ff52affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140047c0 0x7ff52c140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60472/0 (socket says 172.21.15.29:60472) 2024-04-09T12:04:19.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.257+0000 7ff52affd640 1 -- 172.21.15.29:0/2399107808 learned_addr learned my addr 172.21.15.29:0/2399107808 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:04:19.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.257+0000 7ff52affd640 10 monclient(hunting): get_auth_request con 0x7ff5140047c0 auth_method 0 2024-04-09T12:04:19.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.257+0000 7ff52affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:19.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.257+0000 7ff52affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:19.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.257+0000 7ff52affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:19.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.258+0000 7ff52affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:19.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.258+0000 7ff52affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:19.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.258+0000 7ff52affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.269+0000 7ff52affd640 10 monclient(hunting): handle_auth_done global_id 4107 payload 824 2024-04-09T12:04:19.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.269+0000 7ff52affd640 1 -- 172.21.15.29:0/2399107808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff52c1c9d60 msgr2=0x7ff52c1ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:19.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.269+0000 7ff52affd640 1 --2- 172.21.15.29:0/2399107808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff52c1c9d60 0x7ff52c1ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:19.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.269+0000 7ff52affd640 1 -- 172.21.15.29:0/2399107808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff52c1cbb50 msgr2=0x7ff52c06fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:19.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.269+0000 7ff52affd640 1 --2- 172.21.15.29:0/2399107808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff52c1cbb50 0x7ff52c06fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:19.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.269+0000 7ff52affd640 10 monclient: _finish_hunting 0 2024-04-09T12:04:19.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.269+0000 7ff52affd640 1 monclient: found mon.noname-a 2024-04-09T12:04:19.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.269+0000 7ff52affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:19.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.269+0000 7ff52affd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:04:19.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.269+0000 7ff52affd640 1 -- 172.21.15.29:0/2399107808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c1cb450 con 0x7ff5140047c0 2024-04-09T12:04:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.276+0000 7ff52affd640 1 --2- 172.21.15.29:0/2399107808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140047c0 0x7ff52c140a70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff51c017ce0 tx=0x7ff51c005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.276+0000 7ff513fff640 10 client.?.objecter ms_handle_connect 0x7ff5140047c0 2024-04-09T12:04:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.276+0000 7ff513fff640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 1 -- 172.21.15.29:0/2399107808 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c019430 con 0x7ff5140047c0 2024-04-09T12:04:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:04:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 10 monclient: dump: 2024-04-09T12:04:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:04:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 10 monclient: _finish_auth 0 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 10 monclient: _check_auth_tickets 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 1 -- 172.21.15.29:0/2399107808 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c00f040 con 0x7ff5140047c0 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 1 -- 172.21.15.29:0/2399107808 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0197f0 con 0x7ff5140047c0 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff531a33640 5 monclient: authenticate success, global_id 4107 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff531a33640 10 monclient: _renew_subs 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff531a33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff531a33640 1 -- 172.21.15.29:0/2399107808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52c1416b0 con 0x7ff5140047c0 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff5297fa640 4 set_mon_vals no callback set 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff513fff640 10 monclient: dump: 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:19.296 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff531a33640 10 client.4107.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff531a33640 10 monclient: _renew_subs 2024-04-09T12:04:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff531a33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff531a33640 1 -- 172.21.15.29:0/2399107808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52c1d9970 con 0x7ff5140047c0 2024-04-09T12:04:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.290+0000 7ff531a33640 1 librados: init done 2024-04-09T12:04:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.291+0000 7ff531a33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:19.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.291+0000 7ff531a33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:19.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.291+0000 7ff531a33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:19.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.291+0000 7ff531a33640 1 -- 172.21.15.29:0/2399107808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52c04e160 con 0x7ff5140047c0 2024-04-09T12:04:19.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.522+0000 7ff513fff640 1 -- 172.21.15.29:0/2399107808 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff51c019950 con 0x7ff5140047c0 2024-04-09T12:04:19.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.522+0000 7ff513fff640 1 -- 172.21.15.29:0/2399107808 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff51c02a830 con 0x7ff5140047c0 2024-04-09T12:04:19.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.522+0000 7ff513fff640 10 client.4107.objecter ms_dispatch 0x7ff52c000b90 osd_map(1..1 src has 1..1) v4 2024-04-09T12:04:19.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.522+0000 7ff513fff640 3 client.4107.objecter handle_osd_map got epochs [1,1] > 0 2024-04-09T12:04:19.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.522+0000 7ff513fff640 3 client.4107.objecter handle_osd_map decoding full epoch 1 2024-04-09T12:04:19.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.522+0000 7ff513fff640 20 client.4107.objecter dump_active .. 0 homeless 2024-04-09T12:04:19.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.522+0000 7ff513fff640 1 -- 172.21.15.29:0/2399107808 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72706 (secure 0 0 0) 0x7ff51c01d070 con 0x7ff5140047c0 2024-04-09T12:04:19.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.522+0000 7ff513fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:19.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.522+0000 7ff513fff640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:19.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.592+0000 7ff531a33640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2024-04-09T12:04:19.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.592+0000 7ff531a33640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-04-09T12:04:19.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.592+0000 7ff531a33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:19.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.592+0000 7ff531a33640 1 -- 172.21.15.29:0/2399107808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff52c0b3450 con 0x7ff5140047c0 2024-04-09T12:04:19.808 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:19.806+0000 7f1d2f23b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-09T12:04:19.869 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:19.868+0000 7f1d2f23b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-09T12:04:19.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.867+0000 7ff513fff640 1 -- 172.21.15.29:0/2399107808 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff51c019d40 con 0x7ff5140047c0 2024-04-09T12:04:19.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.867+0000 7ff513fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-04-09T12:04:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.867+0000 7ff513fff640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2024-04-09T12:04:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-04-09T12:04:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 10 librados: watch_flush enter 2024-04-09T12:04:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 10 librados: watch_flush exit 2024-04-09T12:04:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 20 client.4107.objecter shutdown clearing up homeless session... 2024-04-09T12:04:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 10 client.4107.objecter successfully canceled tick 2024-04-09T12:04:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 10 monclient: shutdown 2024-04-09T12:04:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 1 -- 172.21.15.29:0/2399107808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140047c0 msgr2=0x7ff52c140a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 1 --2- 172.21.15.29:0/2399107808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140047c0 0x7ff52c140a70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff51c017ce0 tx=0x7ff51c005420 comp rx=0 tx=0).stop 2024-04-09T12:04:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 1 -- 172.21.15.29:0/2399107808 shutdown_connections 2024-04-09T12:04:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 1 --2- 172.21.15.29:0/2399107808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff52c1c9d60 0x7ff52c1ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 1 --2- 172.21.15.29:0/2399107808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff52c1cbb50 0x7ff52c06fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 1 --2- 172.21.15.29:0/2399107808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140047c0 0x7ff52c140a70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 1 -- 172.21.15.29:0/2399107808 >> 172.21.15.29:0/2399107808 conn(0x7ff52c0b3e70 msgr2=0x7ff52c13e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 1 -- 172.21.15.29:0/2399107808 shutdown_connections 2024-04-09T12:04:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 1 -- 172.21.15.29:0/2399107808 wait complete. 2024-04-09T12:04:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:19.868+0000 7ff531a33640 1 librados: shutdown 2024-04-09T12:04:19.877 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:19.874+0000 7f6d5fa0f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-09T12:04:19.883 INFO:tasks.ceph:check_enable_crimson: False 2024-04-09T12:04:19.883 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-09T12:04:19.883 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:04:19.883 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-09T12:04:19.910 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:04:19.910 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-09T12:04:19.935 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:19.932+0000 7f6d5fa0f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-09T12:04:19.961 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:04:19.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-09T12:04:20.028 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:04:20.028 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-09T12:04:20.096 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:04:20.096 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-09T12:04:20.124 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:04:20.124 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-09T12:04:20.191 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:04:20.192 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-09T12:04:20.259 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-09T12:04:20.260 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-09T12:04:20.327 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 7c929787-7de5-4d2f-9b36-3a165fa73386 0 2024-04-09T12:04:20.429 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:20.427+0000 7f1d2f23b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-09T12:04:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.465+0000 7fa8f9166640 10 monclient: get_monmap_and_config 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.465+0000 7fa8f9166640 10 monclient: build_initial_monmap 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.465+0000 7fa8f9166640 10 monclient: monmap: 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:04:20.466015+0000 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:04:20.466015+0000 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:20.469 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 1 Processor -- start 2024-04-09T12:04:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 1 -- start start 2024-04-09T12:04:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 10 monclient: init 2024-04-09T12:04:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2024-04-09T12:04:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa8f40b42f0 0x7fa8f40a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 10 monclient(hunting): picked mon.noname-c con 0x7fa8f40b42f0 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa8f4141660 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8f413e7f0 0x7fa8f413ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 10 monclient(hunting): picked mon.noname-b con 0x7fa8f413e7f0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f40a8de0 con 0x7fa8f4141660 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40b46d0 con 0x7fa8f40b42f0 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40aa450 con 0x7fa8f413e7f0 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.466+0000 7fa8f9166640 10 monclient(hunting): authenticate will time out at 1339.753993s 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.467+0000 7fa8f2d9d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa8f40b42f0 0x7fa8f40a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.467+0000 7fa8f359e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8f413e7f0 0x7fa8f413ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f2d9d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa8f40b42f0 0x7fa8f40a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57082/0 (socket says 172.21.15.173:57082) 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f2d9d640 1 -- 172.21.15.173:0/3097286930 learned_addr learned my addr 172.21.15.173:0/3097286930 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f2d9d640 10 monclient(hunting): get_auth_request con 0x7fa8f40b42f0 auth_method 0 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f2d9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f359e640 10 monclient(hunting): get_auth_request con 0x7fa8f413e7f0 auth_method 0 2024-04-09T12:04:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f359e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f359e640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f359e640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.468+0000 7fa8f2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.469+0000 7fa8f359e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.469+0000 7fa8f359e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.469+0000 7fa8f359e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:20.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.470+0000 7fa8f2d9d640 10 monclient(hunting): handle_auth_done global_id 4111 payload 274 2024-04-09T12:04:20.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.470+0000 7fa8f2d9d640 1 -- 172.21.15.173:0/3097286930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8f413e7f0 msgr2=0x7fa8f413ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:20.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.470+0000 7fa8f2d9d640 1 --2- 172.21.15.173:0/3097286930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8f413e7f0 0x7fa8f413ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:20.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.470+0000 7fa8f2d9d640 1 -- 172.21.15.173:0/3097286930 >> v1:172.21.15.173:6789/0 conn(0x7fa8f4141660 legacy=0x7fa8f4141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:20.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.470+0000 7fa8f2d9d640 10 monclient: _finish_hunting 0 2024-04-09T12:04:20.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.470+0000 7fa8f2d9d640 1 monclient: found mon.noname-c 2024-04-09T12:04:20.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.470+0000 7fa8f2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:20.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.470+0000 7fa8f2d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:04:20.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.470+0000 7fa8f2d9d640 1 -- 172.21.15.173:0/3097286930 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f40aa730 con 0x7fa8f40b42f0 2024-04-09T12:04:20.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.472+0000 7fa8f2d9d640 1 --2- 172.21.15.173:0/3097286930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40b42f0 0x7fa8f40a88a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009870 tx=0x7fa8e402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5a111f78cc43340 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 1 -- 172.21.15.173:0/3097286930 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4030840 con 0x7fa8f40b42f0 2024-04-09T12:04:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:04:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 10 monclient: dump: 2024-04-09T12:04:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 10 monclient: _finish_auth 0 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 10 monclient: _check_auth_tickets 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 1 -- 172.21.15.173:0/3097286930 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e40309a0 con 0x7fa8f40b42f0 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f9166640 5 monclient: authenticate success, global_id 4111 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f9166640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f9166640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 1 -- 172.21.15.173:0/3097286930 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4030d30 con 0x7fa8f40b42f0 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f9166640 4 set_mon_vals no callback set 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.480+0000 7fa8f1d9b640 10 monclient: dump: 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:20.485 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:20.485 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:20.485 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:20.485 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:20.485 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:20.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.481+0000 7fa8f9166640 10 monclient: shutdown 2024-04-09T12:04:20.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.481+0000 7fa8f9166640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:20.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.481+0000 7fa8f9166640 1 -- 172.21.15.173:0/3097286930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40b42f0 msgr2=0x7fa8f40a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:20.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.481+0000 7fa8f9166640 1 --2- 172.21.15.173:0/3097286930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40b42f0 0x7fa8f40a88a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009870 tx=0x7fa8e402b980 comp rx=0 tx=0).stop 2024-04-09T12:04:20.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.481+0000 7fa8f9166640 1 -- 172.21.15.173:0/3097286930 shutdown_connections 2024-04-09T12:04:20.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.481+0000 7fa8f9166640 1 --2- 172.21.15.173:0/3097286930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8f413e7f0 0x7fa8f413ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:20.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.481+0000 7fa8f9166640 1 --2- 172.21.15.173:0/3097286930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40b42f0 0x7fa8f40a88a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.481+0000 7fa8f9166640 1 -- 172.21.15.173:0/3097286930 >> 172.21.15.173:0/3097286930 conn(0x7fa8f4065f30 msgr2=0x7fa8f4066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.481+0000 7fa8f9166640 1 -- 172.21.15.173:0/3097286930 shutdown_connections 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.481+0000 7fa8f9166640 1 -- 172.21.15.173:0/3097286930 wait complete. 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.482+0000 7fa8f9166640 10 monclient: build_initial_monmap 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.482+0000 7fa8f9166640 10 monclient: monmap: 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:20.487 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:20.488 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:20.482+0000 7f1d2f23b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-09T12:04:20.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.482+0000 7fa8f9166640 1 librados: starting msgr at 2024-04-09T12:04:20.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.482+0000 7fa8f9166640 1 librados: starting objecter 2024-04-09T12:04:20.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 1 Processor -- start 2024-04-09T12:04:20.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 1 -- start start 2024-04-09T12:04:20.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 1 librados: setting wanted keys 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 1 librados: calling monclient init 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 10 monclient: init 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40b42f0 0x7fa8f413a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 10 monclient(hunting): picked mon.noname-b con 0x7fa8f40b42f0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8f413e7f0 0x7fa8f41d9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 10 monclient(hunting): picked mon.noname-a con 0x7fa8f413e7f0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8f4141660 0x7fa8f41da300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 10 monclient(hunting): picked mon.noname-c con 0x7fa8f4141660 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4139100 con 0x7fa8f413e7f0 2024-04-09T12:04:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f41d98e0 con 0x7fa8f40b42f0 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4139c40 con 0x7fa8f4141660 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.483+0000 7fa8f9166640 10 monclient(hunting): authenticate will time out at 1339.770747s 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f2d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40b42f0 0x7fa8f413a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8f413e7f0 0x7fa8f41d9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f359e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8f4141660 0x7fa8f41da300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f2d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40b42f0 0x7fa8f413a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57098/0 (socket says 172.21.15.173:57098) 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f2d9d640 1 -- 172.21.15.173:0/2875556833 learned_addr learned my addr 172.21.15.173:0/2875556833 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f2d9d640 10 monclient(hunting): get_auth_request con 0x7fa8f40b42f0 auth_method 0 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:20.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f2d9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f259c640 10 monclient(hunting): get_auth_request con 0x7fa8f413e7f0 auth_method 0 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f259c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f259c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f359e640 10 monclient(hunting): get_auth_request con 0x7fa8f4141660 auth_method 0 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f359e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f359e640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.484+0000 7fa8f359e640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.485+0000 7fa8f2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.485+0000 7fa8f2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.485+0000 7fa8f2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:20.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.485+0000 7fa8f259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.485+0000 7fa8f259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.485+0000 7fa8f259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.485+0000 7fa8f359e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.485+0000 7fa8f359e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.485+0000 7fa8f359e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.487+0000 7fa8f2d9d640 10 monclient(hunting): handle_auth_done global_id 4117 payload 824 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.487+0000 7fa8f2d9d640 1 -- 172.21.15.173:0/2875556833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8f4141660 msgr2=0x7fa8f41da300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.487+0000 7fa8f2d9d640 1 --2- 172.21.15.173:0/2875556833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8f4141660 0x7fa8f41da300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.487+0000 7fa8f2d9d640 1 -- 172.21.15.173:0/2875556833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8f413e7f0 msgr2=0x7fa8f41d9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.487+0000 7fa8f2d9d640 1 --2- 172.21.15.173:0/2875556833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8f413e7f0 0x7fa8f41d9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.487+0000 7fa8f2d9d640 10 monclient: _finish_hunting 0 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.487+0000 7fa8f2d9d640 1 monclient: found mon.noname-b 2024-04-09T12:04:20.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.487+0000 7fa8f2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:20.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.487+0000 7fa8f2d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:04:20.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.487+0000 7fa8f2d9d640 1 -- 172.21.15.173:0/2875556833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40094d0 con 0x7fa8f40b42f0 2024-04-09T12:04:20.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.490+0000 7fa8f2d9d640 1 --2- 172.21.15.173:0/2875556833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40b42f0 0x7fa8f413a1d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4000c00 tx=0x7fa8e4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:20.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.490+0000 7fa8db7fe640 10 client.?.objecter ms_handle_connect 0x7fa8f40b42f0 2024-04-09T12:04:20.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.490+0000 7fa8db7fe640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:20.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 1 -- 172.21.15.173:0/2875556833 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4039c90 con 0x7fa8f40b42f0 2024-04-09T12:04:20.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 10 monclient: dump: 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:20.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 10 monclient: _finish_auth 0 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 10 monclient: _check_auth_tickets 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 1 -- 172.21.15.173:0/2875556833 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4039e10 con 0x7fa8f40b42f0 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8f9166640 5 monclient: authenticate success, global_id 4117 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8f9166640 10 monclient: _renew_subs 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8f9166640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8f9166640 1 -- 172.21.15.173:0/2875556833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f4137590 con 0x7fa8f40b42f0 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 1 -- 172.21.15.173:0/2875556833 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4043640 con 0x7fa8f40b42f0 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8db7fe640 10 monclient: dump: 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:20.499 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8f159a640 4 set_mon_vals no callback set 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8f9166640 10 client.4117.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8f9166640 10 monclient: _renew_subs 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8f9166640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8f9166640 1 -- 172.21.15.173:0/2875556833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f413b2b0 con 0x7fa8f40b42f0 2024-04-09T12:04:20.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.493+0000 7fa8f9166640 1 librados: init done 2024-04-09T12:04:20.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.494+0000 7fa8f9166640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:20.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.494+0000 7fa8f9166640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:20.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.494+0000 7fa8f9166640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:20.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.494+0000 7fa8f9166640 1 -- 172.21.15.173:0/2875556833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f4139db0 con 0x7fa8f40b42f0 2024-04-09T12:04:20.509 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:20.506+0000 7f6d5fa0f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-09T12:04:20.553 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:20.551+0000 7f1d2f23b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-09T12:04:20.563 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:20.560+0000 7f6d5fa0f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-09T12:04:20.609 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:20.606+0000 7f6d5fa0f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-09T12:04:20.610 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:20.608+0000 7f1d2f23b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-09T12:04:20.653 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:20.651+0000 7f1d2f23b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-09T12:04:20.664 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:20.661+0000 7f6d5fa0f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-09T12:04:20.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.696+0000 7fa8db7fe640 1 -- 172.21.15.173:0/2875556833 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa8e4043aa0 con 0x7fa8f40b42f0 2024-04-09T12:04:20.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.696+0000 7fa8db7fe640 1 -- 172.21.15.173:0/2875556833 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa8e403e070 con 0x7fa8f40b42f0 2024-04-09T12:04:20.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.696+0000 7fa8db7fe640 10 client.4117.objecter ms_dispatch 0x7fa8f4000b90 osd_map(2..2 src has 1..2) v4 2024-04-09T12:04:20.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.696+0000 7fa8db7fe640 3 client.4117.objecter handle_osd_map got epochs [2,2] > 0 2024-04-09T12:04:20.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.696+0000 7fa8db7fe640 3 client.4117.objecter handle_osd_map decoding full epoch 2 2024-04-09T12:04:20.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.696+0000 7fa8db7fe640 20 client.4117.objecter dump_active .. 0 homeless 2024-04-09T12:04:20.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.696+0000 7fa8db7fe640 1 -- 172.21.15.173:0/2875556833 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72706 (secure 0 0 0) 0x7fa8e4034070 con 0x7fa8f40b42f0 2024-04-09T12:04:20.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.696+0000 7fa8db7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:20.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.696+0000 7fa8db7fe640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:20.708 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:20.705+0000 7f6d5fa0f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-09T12:04:20.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.768+0000 7fa8f9166640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7c929787-7de5-4d2f-9b36-3a165fa73386", "id": 0}] 2024-04-09T12:04:20.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.768+0000 7fa8f9166640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7c929787-7de5-4d2f-9b36-3a165fa73386", "id": 0}] 2024-04-09T12:04:20.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.768+0000 7fa8f9166640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:20.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.768+0000 7fa8f9166640 1 -- 172.21.15.173:0/2875556833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c929787-7de5-4d2f-9b36-3a165fa73386", "id": 0} v 0) v1 -- 0x7fa8f404e160 con 0x7fa8f40b42f0 2024-04-09T12:04:20.772 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:20.770+0000 7f1d2f23b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-09T12:04:20.827 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:20.824+0000 7f6d5fa0f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-09T12:04:20.843 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:20.841+0000 7f1d2f23b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-09T12:04:20.888 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:20.887+0000 7f1d2f23b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-09T12:04:20.902 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:20.899+0000 7f6d5fa0f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-09T12:04:20.943 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:20.941+0000 7f1d2f23b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-09T12:04:20.952 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:20.949+0000 7f6d5fa0f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-09T12:04:20.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.958+0000 7fa8db7fe640 1 -- 172.21.15.173:0/2875556833 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c929787-7de5-4d2f-9b36-3a165fa73386", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa8e404d460 con 0x7fa8f40b42f0 2024-04-09T12:04:20.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.958+0000 7fa8db7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7c929787-7de5-4d2f-9b36-3a165fa73386", "id": 0}] 2024-04-09T12:04:20.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.958+0000 7fa8db7fe640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:20.960 INFO:teuthology.orchestra.run.smithi173.stdout:0 2024-04-09T12:04:20.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 10 librados: watch_flush enter 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 10 librados: watch_flush exit 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 20 client.4117.objecter shutdown clearing up homeless session... 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 10 client.4117.objecter successfully canceled tick 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 10 monclient: shutdown 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 1 -- 172.21.15.173:0/2875556833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40b42f0 msgr2=0x7fa8f413a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 1 --2- 172.21.15.173:0/2875556833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40b42f0 0x7fa8f413a1d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4000c00 tx=0x7fa8e4004730 comp rx=0 tx=0).stop 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 1 -- 172.21.15.173:0/2875556833 shutdown_connections 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 1 --2- 172.21.15.173:0/2875556833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8f4141660 0x7fa8f41da300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 1 --2- 172.21.15.173:0/2875556833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8f413e7f0 0x7fa8f41d9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 1 --2- 172.21.15.173:0/2875556833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40b42f0 0x7fa8f413a1d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:20.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 1 -- 172.21.15.173:0/2875556833 >> 172.21.15.173:0/2875556833 conn(0x7fa8f4065f30 msgr2=0x7fa8f40b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:20.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 1 -- 172.21.15.173:0/2875556833 shutdown_connections 2024-04-09T12:04:20.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 1 -- 172.21.15.173:0/2875556833 wait complete. 2024-04-09T12:04:20.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:20.959+0000 7fa8f9166640 1 librados: shutdown 2024-04-09T12:04:20.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 54d0b5c7-3415-4585-8a9b-c67a8ae94ce9 1 2024-04-09T12:04:20.993 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:20.991+0000 7f1d2f23b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-09T12:04:21.010 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:21.007+0000 7f6d5fa0f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-09T12:04:21.061 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:21.058+0000 7f6d5fa0f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-09T12:04:21.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.069+0000 7fac2421d640 10 monclient: get_monmap_and_config 2024-04-09T12:04:21.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.069+0000 7fac2421d640 10 monclient: build_initial_monmap 2024-04-09T12:04:21.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.069+0000 7fac2421d640 10 monclient: monmap: 2024-04-09T12:04:21.071 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:21.071 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.071 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:04:21.070004+0000 2024-04-09T12:04:21.071 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:04:21.070004+0000 2024-04-09T12:04:21.072 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:21.072 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.072 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:21.072 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:21.072 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:21.072 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:21.072 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:21.072 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.070+0000 7fac2421d640 1 Processor -- start 2024-04-09T12:04:21.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.070+0000 7fac2421d640 1 -- start start 2024-04-09T12:04:21.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.070+0000 7fac2421d640 10 monclient: init 2024-04-09T12:04:21.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:21.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 10 monclient: _add_conns ranks=[4,3,2,1,0] 2024-04-09T12:04:21.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fac1c0a8a80 0x7fac1c0a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 10 monclient(hunting): picked mon.noname-c con 0x7fac1c0a8a80 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:21.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fac1c0a93a0 0x7fac1c145140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 10 monclient(hunting): picked mon.noname-a con 0x7fac1c0a93a0 addr v2:172.21.15.29:3300/0 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fac1c145680 0x7fac1c13e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 10 monclient(hunting): picked mon.noname-b con 0x7fac1c145680 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1c145af0 con 0x7fac1c0a93a0 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1c0b7b80 con 0x7fac1c0a8a80 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c144c20 con 0x7fac1c145680 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac2421d640 10 monclient(hunting): authenticate will time out at 1340.358270s 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac21fb9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fac1c0a8a80 0x7fac1c0a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac217b8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fac1c0a93a0 0x7fac1c145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.071+0000 7fac227ba640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fac1c145680 0x7fac1c13e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac217b8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fac1c0a93a0 0x7fac1c145140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.173:54622/0 (socket says 172.21.15.173:54622) 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac217b8640 1 -- 172.21.15.173:0/4081142833 learned_addr learned my addr 172.21.15.173:0/4081142833 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac217b8640 10 monclient(hunting): get_auth_request con 0x7fac1c0a93a0 auth_method 0 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac217b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac217b8640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac217b8640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac21fb9640 10 monclient(hunting): get_auth_request con 0x7fac1c0a8a80 auth_method 0 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac21fb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac21fb9640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac21fb9640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac21fb9640 1 -- 172.21.15.173:0/4081142833 >> v2:172.21.15.173:3300/0 conn(0x7fac1c0a8a80 msgr2=0x7fac1c0a8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac21fb9640 1 -- 172.21.15.173:0/4081142833 >> v2:172.21.15.173:3300/0 conn(0x7fac1c0a8a80 msgr2=0x7fac1c0a8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac21fb9640 1 --2- 172.21.15.173:0/4081142833 >> v2:172.21.15.173:3300/0 conn(0x7fac1c0a8a80 0x7fac1c0a8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-09T12:04:21.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac21fb9640 1 --2- 172.21.15.173:0/4081142833 >> v2:172.21.15.173:3300/0 conn(0x7fac1c0a8a80 0x7fac1c0a8e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T12:04:21.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac227ba640 10 monclient(hunting): get_auth_request con 0x7fac1c145680 auth_method 0 2024-04-09T12:04:21.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac227ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac227ba640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac227ba640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac217b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac217b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.072+0000 7fac217b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.073+0000 7fac227ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.073+0000 7fac227ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.073+0000 7fac227ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.074+0000 7fac217b8640 10 monclient(hunting): handle_auth_done global_id 4113 payload 274 2024-04-09T12:04:21.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.074+0000 7fac217b8640 1 -- 172.21.15.173:0/4081142833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fac1c145680 msgr2=0x7fac1c13e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:21.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.074+0000 7fac217b8640 1 --2- 172.21.15.173:0/4081142833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fac1c145680 0x7fac1c13e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.074+0000 7fac217b8640 1 -- 172.21.15.173:0/4081142833 >> v2:172.21.15.173:3300/0 conn(0x7fac1c0a8a80 msgr2=0x7fac1c0a8e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T12:04:21.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.074+0000 7fac217b8640 1 --2- 172.21.15.173:0/4081142833 >> v2:172.21.15.173:3300/0 conn(0x7fac1c0a8a80 0x7fac1c0a8e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.074+0000 7fac217b8640 10 monclient: _finish_hunting 0 2024-04-09T12:04:21.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.074+0000 7fac217b8640 1 monclient: found mon.noname-a 2024-04-09T12:04:21.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.074+0000 7fac217b8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:21.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.074+0000 7fac217b8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:04:21.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.074+0000 7fac217b8640 1 -- 172.21.15.173:0/4081142833 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c0b1a60 con 0x7fac1c0a93a0 2024-04-09T12:04:21.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.076+0000 7fac217b8640 1 --2- 172.21.15.173:0/4081142833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1c0a93a0 0x7fac1c145140 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fac1c071e00 tx=0x7fac0c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e57f6fac8d13ced server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:21.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 1 -- 172.21.15.173:0/4081142833 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c031870 con 0x7fac1c0a93a0 2024-04-09T12:04:21.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:04:21.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 10 monclient: dump: 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 10 monclient: _finish_auth 0 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 10 monclient: _check_auth_tickets 2024-04-09T12:04:21.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 1 -- 172.21.15.173:0/4081142833 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c0319d0 con 0x7fac1c0a93a0 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 5 monclient: authenticate success, global_id 4113 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 4 set_mon_vals no callback set 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 1 -- 172.21.15.173:0/4081142833 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c031d60 con 0x7fac1c0a93a0 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac20fb7640 10 monclient: dump: 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.084 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 10 monclient: shutdown 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 1 -- 172.21.15.173:0/4081142833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1c0a93a0 msgr2=0x7fac1c145140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 1 --2- 172.21.15.173:0/4081142833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1c0a93a0 0x7fac1c145140 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fac1c071e00 tx=0x7fac0c02b910 comp rx=0 tx=0).stop 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 1 -- 172.21.15.173:0/4081142833 shutdown_connections 2024-04-09T12:04:21.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 1 --2- 172.21.15.173:0/4081142833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fac1c145680 0x7fac1c13e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 1 --2- 172.21.15.173:0/4081142833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1c0a93a0 0x7fac1c145140 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 1 --2- 172.21.15.173:0/4081142833 >> v2:172.21.15.173:3300/0 conn(0x7fac1c0a8a80 0x7fac1c0a8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 1 -- 172.21.15.173:0/4081142833 >> 172.21.15.173:0/4081142833 conn(0x7fac1c0b7060 msgr2=0x7fac1c0b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:21.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 1 -- 172.21.15.173:0/4081142833 shutdown_connections 2024-04-09T12:04:21.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.080+0000 7fac2421d640 1 -- 172.21.15.173:0/4081142833 wait complete. 2024-04-09T12:04:21.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.081+0000 7fac2421d640 10 monclient: build_initial_monmap 2024-04-09T12:04:21.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.081+0000 7fac2421d640 10 monclient: monmap: 2024-04-09T12:04:21.090 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:21.090 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:21.090 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-04-09T12:04:21.090 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.081+0000 7fac2421d640 1 librados: starting msgr at 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.081+0000 7fac2421d640 1 librados: starting objecter 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.081+0000 7fac2421d640 1 Processor -- start 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.081+0000 7fac2421d640 1 -- start start 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.081+0000 7fac2421d640 1 librados: setting wanted keys 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.081+0000 7fac2421d640 1 librados: calling monclient init 2024-04-09T12:04:21.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.081+0000 7fac2421d640 10 monclient: init 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac1c0a8a80 0x7fac1c1401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 10 monclient(hunting): picked mon.noname-b con 0x7fac1c0a8a80 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fac1c0a93a0 0x7fac1c1d9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 10 monclient(hunting): picked mon.noname-c con 0x7fac1c0a93a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1c145680 0x7fac1c1d9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 10 monclient(hunting): picked mon.noname-a con 0x7fac1c145680 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c141fe0 con 0x7fac1c145680 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c140d20 con 0x7fac1c0a8a80 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c144290 con 0x7fac1c0a93a0 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac2421d640 10 monclient(hunting): authenticate will time out at 1340.369543s 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac227ba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1c145680 0x7fac1c1d9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.082+0000 7fac21fb9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac1c0a8a80 0x7fac1c1401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac217b8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fac1c0a93a0 0x7fac1c1d9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac227ba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1c145680 0x7fac1c1d9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.173:54624/0 (socket says 172.21.15.173:54624) 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac227ba640 1 -- 172.21.15.173:0/446833606 learned_addr learned my addr 172.21.15.173:0/446833606 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac227ba640 10 monclient(hunting): get_auth_request con 0x7fac1c145680 auth_method 0 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac227ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac227ba640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac227ba640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac217b8640 10 monclient(hunting): get_auth_request con 0x7fac1c0a93a0 auth_method 0 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac217b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac217b8640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac217b8640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac21fb9640 10 monclient(hunting): get_auth_request con 0x7fac1c0a8a80 auth_method 0 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac21fb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac21fb9640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac21fb9640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac227ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac227ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac227ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac217b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac217b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac217b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac21fb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac21fb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.083+0000 7fac21fb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.086+0000 7fac21fb9640 10 monclient(hunting): handle_auth_done global_id 4123 payload 824 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.086+0000 7fac21fb9640 1 -- 172.21.15.173:0/446833606 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fac1c0a93a0 msgr2=0x7fac1c1d9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.086+0000 7fac21fb9640 1 --2- 172.21.15.173:0/446833606 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fac1c0a93a0 0x7fac1c1d9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.086+0000 7fac21fb9640 1 -- 172.21.15.173:0/446833606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1c145680 msgr2=0x7fac1c1d9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.086+0000 7fac21fb9640 1 --2- 172.21.15.173:0/446833606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1c145680 0x7fac1c1d9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.086+0000 7fac21fb9640 10 monclient: _finish_hunting 0 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.086+0000 7fac21fb9640 1 monclient: found mon.noname-b 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.086+0000 7fac21fb9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:21.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.086+0000 7fac21fb9640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.086+0000 7fac21fb9640 1 -- 172.21.15.173:0/446833606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c0094d0 con 0x7fac1c0a8a80 2024-04-09T12:04:21.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.088+0000 7fac21fb9640 1 --2- 172.21.15.173:0/446833606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac1c0a8a80 0x7fac1c1401f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac1800d5c0 tx=0x7fac1800da80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:21.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.088+0000 7fac127fc640 10 client.?.objecter ms_handle_connect 0x7fac1c0a8a80 2024-04-09T12:04:21.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.088+0000 7fac127fc640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:21.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 1 -- 172.21.15.173:0/446833606 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18014620 con 0x7fac1c0a8a80 2024-04-09T12:04:21.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:04:21.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 10 monclient: dump: 2024-04-09T12:04:21.097 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.097 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 10 monclient: _finish_auth 0 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 10 monclient: _check_auth_tickets 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 1 -- 172.21.15.173:0/446833606 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180147a0 con 0x7fac1c0a8a80 2024-04-09T12:04:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac2421d640 5 monclient: authenticate success, global_id 4123 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac2421d640 10 monclient: _renew_subs 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 1 -- 172.21.15.173:0/446833606 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18014950 con 0x7fac1c0a8a80 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac2421d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac2421d640 1 -- 172.21.15.173:0/446833606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1c142370 con 0x7fac1c0a8a80 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac127fc640 10 monclient: dump: 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac13fff640 4 set_mon_vals no callback set 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac2421d640 10 client.4123.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac2421d640 10 monclient: _renew_subs 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac2421d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac2421d640 1 -- 172.21.15.173:0/446833606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1c1da710 con 0x7fac1c0a8a80 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.094+0000 7fac2421d640 1 librados: init done 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.095+0000 7fac2421d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:21.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.095+0000 7fac2421d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:21.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.095+0000 7fac2421d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.095+0000 7fac2421d640 1 -- 172.21.15.173:0/446833606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1c04e160 con 0x7fac1c0a8a80 2024-04-09T12:04:21.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.222+0000 7fac127fc640 1 -- 172.21.15.173:0/446833606 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fac18027480 con 0x7fac1c0a8a80 2024-04-09T12:04:21.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.222+0000 7fac127fc640 1 -- 172.21.15.173:0/446833606 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fac1801d410 con 0x7fac1c0a8a80 2024-04-09T12:04:21.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.222+0000 7fac127fc640 10 client.4123.objecter ms_dispatch 0x7fac1c000b90 osd_map(3..3 src has 1..3) v4 2024-04-09T12:04:21.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.222+0000 7fac127fc640 3 client.4123.objecter handle_osd_map got epochs [3,3] > 0 2024-04-09T12:04:21.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.222+0000 7fac127fc640 3 client.4123.objecter handle_osd_map decoding full epoch 3 2024-04-09T12:04:21.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.222+0000 7fac127fc640 20 client.4123.objecter dump_active .. 0 homeless 2024-04-09T12:04:21.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.222+0000 7fac127fc640 1 -- 172.21.15.173:0/446833606 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72706 (secure 0 0 0) 0x7fac18018030 con 0x7fac1c0a8a80 2024-04-09T12:04:21.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.222+0000 7fac127fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:21.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.222+0000 7fac127fc640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:21.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.295+0000 7fac2421d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "54d0b5c7-3415-4585-8a9b-c67a8ae94ce9", "id": 1}] 2024-04-09T12:04:21.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.295+0000 7fac2421d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "54d0b5c7-3415-4585-8a9b-c67a8ae94ce9", "id": 1}] 2024-04-09T12:04:21.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.295+0000 7fac2421d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.295+0000 7fac2421d640 1 -- 172.21.15.173:0/446833606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "54d0b5c7-3415-4585-8a9b-c67a8ae94ce9", "id": 1} v 0) v1 -- 0x7fac1c0b5240 con 0x7fac1c0a8a80 2024-04-09T12:04:21.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.372+0000 7fac127fc640 1 -- 172.21.15.173:0/446833606 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "54d0b5c7-3415-4585-8a9b-c67a8ae94ce9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac18027950 con 0x7fac1c0a8a80 2024-04-09T12:04:21.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.372+0000 7fac127fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "54d0b5c7-3415-4585-8a9b-c67a8ae94ce9", "id": 1}] 2024-04-09T12:04:21.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.372+0000 7fac127fc640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:21.375 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-09T12:04:21.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 10 librados: watch_flush enter 2024-04-09T12:04:21.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 10 librados: watch_flush exit 2024-04-09T12:04:21.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 20 client.4123.objecter shutdown clearing up homeless session... 2024-04-09T12:04:21.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 10 client.4123.objecter successfully canceled tick 2024-04-09T12:04:21.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 10 monclient: shutdown 2024-04-09T12:04:21.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 1 -- 172.21.15.173:0/446833606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac1c0a8a80 msgr2=0x7fac1c1401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 1 --2- 172.21.15.173:0/446833606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac1c0a8a80 0x7fac1c1401f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac1800d5c0 tx=0x7fac1800da80 comp rx=0 tx=0).stop 2024-04-09T12:04:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 1 -- 172.21.15.173:0/446833606 shutdown_connections 2024-04-09T12:04:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 1 --2- 172.21.15.173:0/446833606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1c145680 0x7fac1c1d9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 1 --2- 172.21.15.173:0/446833606 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fac1c0a93a0 0x7fac1c1d9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 1 --2- 172.21.15.173:0/446833606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac1c0a8a80 0x7fac1c1401f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 1 -- 172.21.15.173:0/446833606 >> 172.21.15.173:0/446833606 conn(0x7fac1c0b7060 msgr2=0x7fac1c0b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 1 -- 172.21.15.173:0/446833606 shutdown_connections 2024-04-09T12:04:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 1 -- 172.21.15.173:0/446833606 wait complete. 2024-04-09T12:04:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.373+0000 7fac2421d640 1 librados: shutdown 2024-04-09T12:04:21.385 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 7a343481-8465-4e19-989c-4a62c926338c 2 2024-04-09T12:04:21.410 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:21.408+0000 7f1d2f23b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-09T12:04:21.468 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:21.465+0000 7f6d5fa0f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-09T12:04:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.507+0000 7f09800c2640 10 monclient: get_monmap_and_config 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.507+0000 7f09800c2640 10 monclient: build_initial_monmap 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.507+0000 7f09800c2640 10 monclient: monmap: 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:04:21.507347+0000 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:04:21.507347+0000 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:21.510 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:21.510 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.507+0000 7f09800c2640 1 Processor -- start 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.507+0000 7f09800c2640 1 -- start start 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.507+0000 7f09800c2640 10 monclient: init 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f09780b42f0 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0978141660 addr v1:172.21.15.29:6789/0 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f097813e7f0 0x7f097813ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 10 monclient(hunting): picked mon.noname-c con 0x7f097813e7f0 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09780aa450 con 0x7f0978141660 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09780aa730 con 0x7f09780b42f0 2024-04-09T12:04:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09780b46d0 con 0x7f097813e7f0 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.508+0000 7f09800c2640 10 monclient(hunting): authenticate will time out at 1340.795686s 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.509+0000 7f097d65d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0978141660 0x7f0978141a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.173:33054/0 (socket says 172.21.15.173:33054) 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.509+0000 7f097e65f640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f097813e7f0 0x7f097813ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.509+0000 7f097d65d640 1 -- 172.21.15.173:0/3385306123 learned_addr learned my addr 172.21.15.173:0/3385306123 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.509+0000 7f097e65f640 10 monclient(hunting): get_auth_request con 0x7f097813e7f0 auth_method 0 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.509+0000 7f097e65f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.509+0000 7f097e65f640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.509+0000 7f097e65f640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.510+0000 7f097e65f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.510+0000 7f097e65f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.510+0000 7f097e65f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.511+0000 7f097ce5c640 1 -- 172.21.15.173:0/3385306123 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610375680 0 0) 0x7f09780aa450 con 0x7f0978141660 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.511+0000 7f097ce5c640 10 monclient(hunting): _negotiate 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.511+0000 7f097ce5c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.511+0000 7f097ce5c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.511+0000 7f097ce5c640 10 monclient(hunting): my global_id is 4119 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.511+0000 7f097ce5c640 1 -- 172.21.15.173:0/3385306123 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0964003520 con 0x7f0978141660 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.512+0000 7f097e65f640 10 monclient(hunting): handle_auth_done global_id 4126 payload 274 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.512+0000 7f097e65f640 1 -- 172.21.15.173:0/3385306123 >> v1:172.21.15.173:6789/0 conn(0x7f09780b42f0 legacy=0x7f09780a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.512+0000 7f097e65f640 1 -- 172.21.15.173:0/3385306123 >> v1:172.21.15.29:6789/0 conn(0x7f0978141660 legacy=0x7f0978141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.512+0000 7f097e65f640 10 monclient: _finish_hunting 0 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.512+0000 7f097e65f640 1 monclient: found mon.noname-c 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.512+0000 7f097e65f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.512+0000 7f097e65f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.512+0000 7f097e65f640 1 -- 172.21.15.173:0/3385306123 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09780a9070 con 0x7f097813e7f0 2024-04-09T12:04:21.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.516+0000 7f097e65f640 1 --2- 172.21.15.173:0/3385306123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f097813e7f0 0x7f097813ec40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0970009d90 tx=0x7f097002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=326f37a9fda2cc2c server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:21.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 1 -- 172.21.15.173:0/3385306123 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097002cc60 con 0x7f097813e7f0 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 10 monclient: dump: 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 10 monclient: _finish_auth 0 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 10 monclient: _check_auth_tickets 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 1 -- 172.21.15.173:0/3385306123 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097002cdc0 con 0x7f097813e7f0 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f09800c2640 5 monclient: authenticate success, global_id 4126 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f09800c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f09800c2640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f09800c2640 4 set_mon_vals no callback set 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 1 -- 172.21.15.173:0/3385306123 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970034660 con 0x7f097813e7f0 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:21.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f097ce5c640 10 monclient: dump: 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f09800c2640 10 monclient: shutdown 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f09800c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f09800c2640 1 -- 172.21.15.173:0/3385306123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f097813e7f0 msgr2=0x7f097813ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f09800c2640 1 --2- 172.21.15.173:0/3385306123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f097813e7f0 0x7f097813ec40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0970009d90 tx=0x7f097002beb0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f09800c2640 1 -- 172.21.15.173:0/3385306123 shutdown_connections 2024-04-09T12:04:21.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f09800c2640 1 --2- 172.21.15.173:0/3385306123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f097813e7f0 0x7f097813ec40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.520+0000 7f09800c2640 1 -- 172.21.15.173:0/3385306123 >> 172.21.15.173:0/3385306123 conn(0x7f0978065f30 msgr2=0x7f0978066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:21.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.521+0000 7f09800c2640 1 -- 172.21.15.173:0/3385306123 shutdown_connections 2024-04-09T12:04:21.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.521+0000 7f09800c2640 1 -- 172.21.15.173:0/3385306123 wait complete. 2024-04-09T12:04:21.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.521+0000 7f09800c2640 10 monclient: build_initial_monmap 2024-04-09T12:04:21.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.521+0000 7f09800c2640 10 monclient: monmap: 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 librados: starting msgr at 2024-04-09T12:04:21.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 librados: starting objecter 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 Processor -- start 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 -- start start 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 librados: setting wanted keys 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 librados: calling monclient init 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 10 monclient: init 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09780b42f0 0x7f0978139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 10 monclient(hunting): picked mon.noname-a con 0x7f09780b42f0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f097813e7f0 0x7f09781d6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 10 monclient(hunting): picked mon.noname-b con 0x7f097813e7f0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0978141660 0x7f0978136270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 10 monclient(hunting): picked mon.noname-c con 0x7f0978141660 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:21.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781d6750 con 0x7f09780b42f0 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781d7120 con 0x7f097813e7f0 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09781367b0 con 0x7f0978141660 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.522+0000 7f09800c2640 10 monclient(hunting): authenticate will time out at 1340.809863s 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097d65d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f097813e7f0 0x7f09781d6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097de5e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09780b42f0 0x7f0978139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097e65f640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0978141660 0x7f0978136270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097d65d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f097813e7f0 0x7f09781d6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57132/0 (socket says 172.21.15.173:57132) 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097d65d640 1 -- 172.21.15.173:0/2048060696 learned_addr learned my addr 172.21.15.173:0/2048060696 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097d65d640 10 monclient(hunting): get_auth_request con 0x7f097813e7f0 auth_method 0 2024-04-09T12:04:21.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097d65d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097d65d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097d65d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097de5e640 10 monclient(hunting): get_auth_request con 0x7f09780b42f0 auth_method 0 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097de5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097de5e640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097de5e640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097e65f640 10 monclient(hunting): get_auth_request con 0x7f0978141660 auth_method 0 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097e65f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097e65f640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.523+0000 7f097e65f640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.524+0000 7f097d65d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.524+0000 7f097d65d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.524+0000 7f097d65d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.524+0000 7f097de5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.524+0000 7f097de5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.524+0000 7f097de5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.524+0000 7f097e65f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.524+0000 7f097e65f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.524+0000 7f097e65f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.526+0000 7f097d65d640 10 monclient(hunting): handle_auth_done global_id 4132 payload 824 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.526+0000 7f097d65d640 1 -- 172.21.15.173:0/2048060696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0978141660 msgr2=0x7f0978136270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.526+0000 7f097d65d640 1 --2- 172.21.15.173:0/2048060696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0978141660 0x7f0978136270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.526+0000 7f097d65d640 1 -- 172.21.15.173:0/2048060696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09780b42f0 msgr2=0x7f0978139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.526+0000 7f097d65d640 1 --2- 172.21.15.173:0/2048060696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09780b42f0 0x7f0978139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.526+0000 7f097d65d640 10 monclient: _finish_hunting 0 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.526+0000 7f097d65d640 1 monclient: found mon.noname-b 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.526+0000 7f097d65d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:21.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.526+0000 7f097d65d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.526+0000 7f097d65d640 1 -- 172.21.15.173:0/2048060696 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0970009a70 con 0x7f097813e7f0 2024-04-09T12:04:21.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.528+0000 7f097d65d640 1 --2- 172.21.15.173:0/2048060696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f097813e7f0 0x7f09781d6be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f097400c500 tx=0x7f097400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:21.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.528+0000 7f096e7fc640 10 client.?.objecter ms_handle_connect 0x7f097813e7f0 2024-04-09T12:04:21.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.528+0000 7f096e7fc640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:21.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 1 -- 172.21.15.173:0/2048060696 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974005ce0 con 0x7f097813e7f0 2024-04-09T12:04:21.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:04:21.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 10 monclient: dump: 2024-04-09T12:04:21.538 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.538 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.538 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.538 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 10 monclient: _finish_auth 0 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 10 monclient: _check_auth_tickets 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 1 -- 172.21.15.173:0/2048060696 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0974005e40 con 0x7f097813e7f0 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f09800c2640 5 monclient: authenticate success, global_id 4132 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f09800c2640 10 monclient: _renew_subs 2024-04-09T12:04:21.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f09800c2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f09800c2640 1 -- 172.21.15.173:0/2048060696 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09781399e0 con 0x7f097813e7f0 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 1 -- 172.21.15.173:0/2048060696 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974007330 con 0x7f097813e7f0 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096e7fc640 10 monclient: dump: 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.540 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f096ffff640 4 set_mon_vals no callback set 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f09800c2640 10 client.4132.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f09800c2640 10 monclient: _renew_subs 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f09800c2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f09800c2640 1 -- 172.21.15.173:0/2048060696 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09781d6450 con 0x7f097813e7f0 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.532+0000 7f09800c2640 1 librados: init done 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.533+0000 7f09800c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.533+0000 7f09800c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.533+0000 7f09800c2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.533+0000 7f09800c2640 1 -- 172.21.15.173:0/2048060696 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097814cee0 con 0x7f097813e7f0 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.535+0000 7f096e7fc640 1 -- 172.21.15.173:0/2048060696 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f097401c440 con 0x7f097813e7f0 2024-04-09T12:04:21.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.535+0000 7f096e7fc640 1 -- 172.21.15.173:0/2048060696 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f097401b7d0 con 0x7f097813e7f0 2024-04-09T12:04:21.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.535+0000 7f096e7fc640 10 client.4132.objecter ms_dispatch 0x7f0978000b90 osd_map(4..4 src has 1..4) v4 2024-04-09T12:04:21.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.535+0000 7f096e7fc640 3 client.4132.objecter handle_osd_map got epochs [4,4] > 0 2024-04-09T12:04:21.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.535+0000 7f096e7fc640 3 client.4132.objecter handle_osd_map decoding full epoch 4 2024-04-09T12:04:21.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.535+0000 7f096e7fc640 20 client.4132.objecter dump_active .. 0 homeless 2024-04-09T12:04:21.553 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:21.551+0000 7f1d2f23b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-09T12:04:21.609 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:21.606+0000 7f6d5fa0f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-09T12:04:21.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.634+0000 7f096e7fc640 1 -- 172.21.15.173:0/2048060696 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72706 (secure 0 0 0) 0x7f097814cee0 con 0x7f097813e7f0 2024-04-09T12:04:21.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.634+0000 7f096e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:21.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.634+0000 7f096e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:21.677 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:21.676+0000 7f1d2f23b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-09T12:04:21.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.706+0000 7f09800c2640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7a343481-8465-4e19-989c-4a62c926338c", "id": 2}] 2024-04-09T12:04:21.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.706+0000 7f09800c2640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7a343481-8465-4e19-989c-4a62c926338c", "id": 2}] 2024-04-09T12:04:21.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.706+0000 7f09800c2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.706+0000 7f09800c2640 1 -- 172.21.15.173:0/2048060696 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a343481-8465-4e19-989c-4a62c926338c", "id": 2} v 0) v1 -- 0x7f097804e160 con 0x7f097813e7f0 2024-04-09T12:04:21.725 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:21.723+0000 7f1d2f23b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-09T12:04:21.738 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:21.735+0000 7f6d5fa0f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-09T12:04:21.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.779+0000 7f096e7fc640 1 -- 172.21.15.173:0/2048060696 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a343481-8465-4e19-989c-4a62c926338c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0974017070 con 0x7f097813e7f0 2024-04-09T12:04:21.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.779+0000 7f096e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7a343481-8465-4e19-989c-4a62c926338c", "id": 2}] 2024-04-09T12:04:21.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.779+0000 7f096e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:21.781 INFO:teuthology.orchestra.run.smithi173.stdout:2 2024-04-09T12:04:21.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.779+0000 7f09800c2640 10 librados: watch_flush enter 2024-04-09T12:04:21.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 10 librados: watch_flush exit 2024-04-09T12:04:21.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 20 client.4132.objecter shutdown clearing up homeless session... 2024-04-09T12:04:21.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 10 client.4132.objecter successfully canceled tick 2024-04-09T12:04:21.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 10 monclient: shutdown 2024-04-09T12:04:21.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:21.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 1 -- 172.21.15.173:0/2048060696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f097813e7f0 msgr2=0x7f09781d6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 1 --2- 172.21.15.173:0/2048060696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f097813e7f0 0x7f09781d6be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f097400c500 tx=0x7f097400c9c0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 1 -- 172.21.15.173:0/2048060696 shutdown_connections 2024-04-09T12:04:21.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 1 --2- 172.21.15.173:0/2048060696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0978141660 0x7f0978136270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 1 --2- 172.21.15.173:0/2048060696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f097813e7f0 0x7f09781d6be0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 1 --2- 172.21.15.173:0/2048060696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09780b42f0 0x7f0978139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 1 -- 172.21.15.173:0/2048060696 >> 172.21.15.173:0/2048060696 conn(0x7f0978065f30 msgr2=0x7f097813b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:21.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 1 -- 172.21.15.173:0/2048060696 shutdown_connections 2024-04-09T12:04:21.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 1 -- 172.21.15.173:0/2048060696 wait complete. 2024-04-09T12:04:21.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.780+0000 7f09800c2640 1 librados: shutdown 2024-04-09T12:04:21.788 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:21.785+0000 7f6d5fa0f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-09T12:04:21.792 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1 3 2024-04-09T12:04:21.846 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:21.845+0000 7f1d2f23b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-09T12:04:21.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.889+0000 7fcef26f5640 10 monclient: get_monmap_and_config 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.889+0000 7fcef26f5640 10 monclient: build_initial_monmap 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.890+0000 7fcef26f5640 10 monclient: monmap: 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:04:21.890266+0000 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:04:21.890266+0000 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:21.892 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.890+0000 7fcef26f5640 1 Processor -- start 2024-04-09T12:04:21.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.890+0000 7fcef26f5640 1 -- start start 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.890+0000 7fcef26f5640 10 monclient: init 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fceec065b10 0x7fceec071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 10 monclient(hunting): picked mon.noname-c con 0x7fceec065b10 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fceec065ef0 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 0x7fceec1417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 10 monclient(hunting): picked mon.noname-b con 0x7fceec0aed30 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec071740 con 0x7fceec065ef0 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec141cf0 con 0x7fceec065b10 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec141f00 con 0x7fceec0aed30 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fcef26f5640 10 monclient(hunting): authenticate will time out at 1341.178458s 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.891+0000 7fceebfff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fceec065b10 0x7fceec071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fcef0c92640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 0x7fceec1417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fcef0c92640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 0x7fceec1417b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.173:49162/0 (socket says 172.21.15.173:49162) 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fcef0c92640 1 -- 172.21.15.173:0/1233977198 learned_addr learned my addr 172.21.15.173:0/1233977198 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fcef0c92640 10 monclient(hunting): get_auth_request con 0x7fceec0aed30 auth_method 0 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fcef0c92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fcef0c92640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fcef0c92640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fceebfff640 10 monclient(hunting): get_auth_request con 0x7fceec065b10 auth_method 0 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fceebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fceebfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fceebfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fcef0c92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fcef0c92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.892+0000 7fcef0c92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.893+0000 7fceebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.893+0000 7fceebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.893+0000 7fceebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.894+0000 7fcef0c92640 10 monclient(hunting): handle_auth_done global_id 4124 payload 274 2024-04-09T12:04:21.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.894+0000 7fcef0c92640 1 -- 172.21.15.173:0/1233977198 >> v2:172.21.15.173:3300/0 conn(0x7fceec065b10 msgr2=0x7fceec071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:21.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.894+0000 7fcef0c92640 1 --2- 172.21.15.173:0/1233977198 >> v2:172.21.15.173:3300/0 conn(0x7fceec065b10 0x7fceec071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.894+0000 7fcef0c92640 1 -- 172.21.15.173:0/1233977198 >> v1:172.21.15.173:6789/0 conn(0x7fceec065ef0 legacy=0x7fceec13ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.894+0000 7fcef0c92640 10 monclient: _finish_hunting 0 2024-04-09T12:04:21.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.894+0000 7fcef0c92640 1 monclient: found mon.noname-b 2024-04-09T12:04:21.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.894+0000 7fcef0c92640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:21.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.894+0000 7fcef0c92640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:04:21.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.894+0000 7fcef0c92640 1 -- 172.21.15.173:0/1233977198 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec13f390 con 0x7fceec0aed30 2024-04-09T12:04:21.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.896+0000 7fcef0c92640 1 --2- 172.21.15.173:0/1233977198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 0x7fceec1417b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fceec141e30 tx=0x7fcee402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28060a0828e1aaaa server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:21.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 1 -- 172.21.15.173:0/1233977198 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee402c9c0 con 0x7fceec0aed30 2024-04-09T12:04:21.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 10 monclient: dump: 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 10 monclient: _finish_auth 0 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 10 monclient: _check_auth_tickets 2024-04-09T12:04:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:21.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 1 -- 172.21.15.173:0/1233977198 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee402cb20 con 0x7fceec0aed30 2024-04-09T12:04:21.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fcef26f5640 5 monclient: authenticate success, global_id 4124 2024-04-09T12:04:21.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fcef26f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:21.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:21.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fcef26f5640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:21.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 1 -- 172.21.15.173:0/1233977198 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee40343f0 con 0x7fceec0aed30 2024-04-09T12:04:21.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fcef26f5640 4 set_mon_vals no callback set 2024-04-09T12:04:21.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:04:21.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.900+0000 7fceeaffd640 10 monclient: dump: 2024-04-09T12:04:21.905 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.905 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.905 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.905 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.905 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.905 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.905 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.905 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.905 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.905 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.906 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:21.901+0000 7f6d5fa0f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-09T12:04:21.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.901+0000 7fcef26f5640 10 monclient: shutdown 2024-04-09T12:04:21.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.901+0000 7fcef26f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:21.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.901+0000 7fcef26f5640 1 -- 172.21.15.173:0/1233977198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 msgr2=0x7fceec1417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.901+0000 7fcef26f5640 1 --2- 172.21.15.173:0/1233977198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 0x7fceec1417b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fceec141e30 tx=0x7fcee402be20 comp rx=0 tx=0).stop 2024-04-09T12:04:21.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.901+0000 7fcef26f5640 1 -- 172.21.15.173:0/1233977198 shutdown_connections 2024-04-09T12:04:21.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.901+0000 7fcef26f5640 1 --2- 172.21.15.173:0/1233977198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 0x7fceec1417b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.901+0000 7fcef26f5640 1 --2- 172.21.15.173:0/1233977198 >> v2:172.21.15.173:3300/0 conn(0x7fceec065b10 0x7fceec071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.901+0000 7fcef26f5640 1 -- 172.21.15.173:0/1233977198 >> 172.21.15.173:0/1233977198 conn(0x7fceec0b3e70 msgr2=0x7fceec0b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.901+0000 7fcef26f5640 1 -- 172.21.15.173:0/1233977198 shutdown_connections 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.901+0000 7fcef26f5640 1 -- 172.21.15.173:0/1233977198 wait complete. 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.902+0000 7fcef26f5640 10 monclient: build_initial_monmap 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.902+0000 7fcef26f5640 10 monclient: monmap: 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:21.910 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.902+0000 7fcef26f5640 1 librados: starting msgr at 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.902+0000 7fcef26f5640 1 librados: starting objecter 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.902+0000 7fcef26f5640 1 Processor -- start 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.902+0000 7fcef26f5640 1 -- start start 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.902+0000 7fcef26f5640 1 librados: setting wanted keys 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.902+0000 7fcef26f5640 1 librados: calling monclient init 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.902+0000 7fcef26f5640 10 monclient: init 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fceec065b10 0x7fceec137ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 10 monclient(hunting): picked mon.noname-a con 0x7fceec065b10 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:21.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 0x7fceec141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 10 monclient(hunting): picked mon.noname-c con 0x7fceec0aed30 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fceec13d250 0x7fceec1d6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 10 monclient(hunting): picked mon.noname-b con 0x7fceec13d250 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec13dbd0 con 0x7fceec065b10 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec140b10 con 0x7fceec13d250 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec13cb20 con 0x7fceec0aed30 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fcef26f5640 10 monclient(hunting): authenticate will time out at 1341.190589s 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.903+0000 7fceeb7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 0x7fceec141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fcef0c92640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fceec13d250 0x7fceec1d6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceebfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fceec065b10 0x7fceec137ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceebfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fceec065b10 0x7fceec137ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.173:54644/0 (socket says 172.21.15.173:54644) 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceeb7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 0x7fceec141600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.173:49176/0 (socket says 172.21.15.173:49176) 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceebfff640 1 -- 172.21.15.173:0/19968056 learned_addr learned my addr 172.21.15.173:0/19968056 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceebfff640 10 monclient(hunting): get_auth_request con 0x7fceec065b10 auth_method 0 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceebfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceebfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceeb7fe640 10 monclient(hunting): get_auth_request con 0x7fceec0aed30 auth_method 0 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceeb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceeb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceeb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fcef0c92640 10 monclient(hunting): get_auth_request con 0x7fceec13d250 auth_method 0 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fcef0c92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fcef0c92640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:21.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fcef0c92640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceeb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceeb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceeb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fceebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fcef0c92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fcef0c92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.904+0000 7fcef0c92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.907+0000 7fcef0c92640 10 monclient(hunting): handle_auth_done global_id 4138 payload 824 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.907+0000 7fcef0c92640 1 -- 172.21.15.173:0/19968056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 msgr2=0x7fceec141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.907+0000 7fcef0c92640 1 --2- 172.21.15.173:0/19968056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 0x7fceec141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.907+0000 7fcef0c92640 1 -- 172.21.15.173:0/19968056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fceec065b10 msgr2=0x7fceec137ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:21.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.907+0000 7fcef0c92640 1 --2- 172.21.15.173:0/19968056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fceec065b10 0x7fceec137ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:21.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.907+0000 7fcef0c92640 10 monclient: _finish_hunting 0 2024-04-09T12:04:21.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.907+0000 7fcef0c92640 1 monclient: found mon.noname-b 2024-04-09T12:04:21.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.907+0000 7fcef0c92640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:21.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.907+0000 7fcef0c92640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.907+0000 7fcef0c92640 1 -- 172.21.15.173:0/19968056 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee4009b30 con 0x7fceec13d250 2024-04-09T12:04:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.909+0000 7fcef0c92640 1 --2- 172.21.15.173:0/19968056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fceec13d250 0x7fceec1d6730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fceec066380 tx=0x7fcee4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.909+0000 7fcee8ff9640 10 client.?.objecter ms_handle_connect 0x7fceec13d250 2024-04-09T12:04:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.909+0000 7fcee8ff9640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 1 -- 172.21.15.173:0/19968056 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee403e450 con 0x7fceec13d250 2024-04-09T12:04:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:04:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 10 monclient: dump: 2024-04-09T12:04:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 10 monclient: _finish_auth 0 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 10 monclient: _check_auth_tickets 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 1 -- 172.21.15.173:0/19968056 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee403e5b0 con 0x7fceec13d250 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcef26f5640 5 monclient: authenticate success, global_id 4138 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcef26f5640 10 monclient: _renew_subs 2024-04-09T12:04:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcef26f5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcef26f5640 1 -- 172.21.15.173:0/19968056 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec13ef90 con 0x7fceec13d250 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 1 -- 172.21.15.173:0/19968056 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee403e960 con 0x7fceec13d250 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee8ff9640 10 monclient: dump: 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:21.919 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcee9ffb640 4 set_mon_vals no callback set 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcef26f5640 10 client.4138.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcef26f5640 10 monclient: _renew_subs 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcef26f5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcef26f5640 1 -- 172.21.15.173:0/19968056 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec1d6e50 con 0x7fceec13d250 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.914+0000 7fcef26f5640 1 librados: init done 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.915+0000 7fcef26f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.915+0000 7fcef26f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.915+0000 7fcef26f5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.915+0000 7fcef26f5640 1 -- 172.21.15.173:0/19968056 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec04e160 con 0x7fceec13d250 2024-04-09T12:04:21.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.917+0000 7fcee8ff9640 1 -- 172.21.15.173:0/19968056 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fcee4051430 con 0x7fceec13d250 2024-04-09T12:04:21.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.917+0000 7fcee8ff9640 1 -- 172.21.15.173:0/19968056 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fcee403edc0 con 0x7fceec13d250 2024-04-09T12:04:21.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.917+0000 7fcee8ff9640 10 client.4138.objecter ms_dispatch 0x7fceec000b90 osd_map(5..5 src has 1..5) v4 2024-04-09T12:04:21.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.917+0000 7fcee8ff9640 3 client.4138.objecter handle_osd_map got epochs [5,5] > 0 2024-04-09T12:04:21.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.917+0000 7fcee8ff9640 3 client.4138.objecter handle_osd_map decoding full epoch 5 2024-04-09T12:04:21.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:21.917+0000 7fcee8ff9640 20 client.4138.objecter dump_active .. 0 homeless 2024-04-09T12:04:21.948 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:21.947+0000 7f1d2f23b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-09T12:04:22.004 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:22.001+0000 7f6d5fa0f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-09T12:04:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.017+0000 7fcee8ff9640 1 -- 172.21.15.173:0/19968056 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72706 (secure 0 0 0) 0x7fcee4043020 con 0x7fceec13d250 2024-04-09T12:04:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.018+0000 7fcee8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.018+0000 7fcee8ff9640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:22.111 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:22.109+0000 7f1d2f23b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-09T12:04:22.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.115+0000 7fcef26f5640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1", "id": 3}] 2024-04-09T12:04:22.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.115+0000 7fcef26f5640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1", "id": 3}] 2024-04-09T12:04:22.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.115+0000 7fcef26f5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:22.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.115+0000 7fcef26f5640 1 -- 172.21.15.173:0/19968056 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1", "id": 3} v 0) v1 -- 0x7fceec0b3870 con 0x7fceec13d250 2024-04-09T12:04:22.158 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:22.156+0000 7f1d2f23b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-09T12:04:22.183 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:22.180+0000 7f6d5fa0f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-09T12:04:22.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcee8ff9640 1 -- 172.21.15.173:0/19968056 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcee40516e0 con 0x7fceec13d250 2024-04-09T12:04:22.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcee8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1", "id": 3}] 2024-04-09T12:04:22.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcee8ff9640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:22.194 INFO:teuthology.orchestra.run.smithi173.stdout:3 2024-04-09T12:04:22.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 10 librados: watch_flush enter 2024-04-09T12:04:22.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 10 librados: watch_flush exit 2024-04-09T12:04:22.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 20 client.4138.objecter shutdown clearing up homeless session... 2024-04-09T12:04:22.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 10 client.4138.objecter successfully canceled tick 2024-04-09T12:04:22.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 10 monclient: shutdown 2024-04-09T12:04:22.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:22.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 1 -- 172.21.15.173:0/19968056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fceec13d250 msgr2=0x7fceec1d6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:22.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 1 --2- 172.21.15.173:0/19968056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fceec13d250 0x7fceec1d6730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fceec066380 tx=0x7fcee4004a40 comp rx=0 tx=0).stop 2024-04-09T12:04:22.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 1 -- 172.21.15.173:0/19968056 shutdown_connections 2024-04-09T12:04:22.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 1 --2- 172.21.15.173:0/19968056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fceec13d250 0x7fceec1d6730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 1 --2- 172.21.15.173:0/19968056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fceec0aed30 0x7fceec141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 1 --2- 172.21.15.173:0/19968056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fceec065b10 0x7fceec137ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.192+0000 7fcef26f5640 1 -- 172.21.15.173:0/19968056 >> 172.21.15.173:0/19968056 conn(0x7fceec0b3e70 msgr2=0x7fceec0ad2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:22.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.193+0000 7fcef26f5640 1 -- 172.21.15.173:0/19968056 shutdown_connections 2024-04-09T12:04:22.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.193+0000 7fcef26f5640 1 -- 172.21.15.173:0/19968056 wait complete. 2024-04-09T12:04:22.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.193+0000 7fcef26f5640 1 librados: shutdown 2024-04-09T12:04:22.205 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 7f553202-73e9-496c-893f-185c61f66807 4 2024-04-09T12:04:22.229 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:22.226+0000 7f6d5fa0f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-09T12:04:22.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.302+0000 7f6e92245640 10 monclient: get_monmap_and_config 2024-04-09T12:04:22.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.302+0000 7f6e92245640 10 monclient: build_initial_monmap 2024-04-09T12:04:22.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.302+0000 7f6e92245640 10 monclient: monmap: 2024-04-09T12:04:22.304 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:22.304 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:22.304 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:04:22.302690+0000 2024-04-09T12:04:22.304 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:04:22.302690+0000 2024-04-09T12:04:22.304 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:22.304 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.305 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:22.305 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:22.305 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:22.305 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:22.305 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:22.305 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 1 Processor -- start 2024-04-09T12:04:22.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 1 -- start start 2024-04-09T12:04:22.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 10 monclient: init 2024-04-09T12:04:22.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:22.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 10 monclient: _add_conns ranks=[3,4,1,0,2] 2024-04-09T12:04:22.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e8c06fd80 0x7f6e8c13c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:22.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 10 monclient(hunting): picked mon.noname-a con 0x7f6e8c06fd80 addr v2:172.21.15.29:3300/0 2024-04-09T12:04:22.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6e8c071000 0x7f6e8c13cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:22.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 10 monclient(hunting): picked mon.noname-c con 0x7f6e8c071000 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:22.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6e8c13f850 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:22.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c0af960 con 0x7f6e8c13f850 2024-04-09T12:04:22.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:22.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c0a85f0 con 0x7f6e8c06fd80 2024-04-09T12:04:22.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:22.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c140370 con 0x7f6e8c071000 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.303+0000 7f6e92245640 10 monclient(hunting): authenticate will time out at 1341.590923s 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8affd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6e8c071000 0x7f6e8c13cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e8c06fd80 0x7f6e8c13c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8affd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6e8c071000 0x7f6e8c13cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57164/0 (socket says 172.21.15.173:57164) 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8affd640 1 -- 172.21.15.173:0/2922470603 learned_addr learned my addr 172.21.15.173:0/2922470603 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8affd640 10 monclient(hunting): get_auth_request con 0x7f6e8c071000 auth_method 0 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8b7fe640 10 monclient(hunting): get_auth_request con 0x7f6e8c06fd80 auth_method 0 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:22.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.304+0000 7f6e8b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.305+0000 7f6e8affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.305+0000 7f6e8affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.305+0000 7f6e8affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.305+0000 7f6e8b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.305+0000 7f6e8b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.305+0000 7f6e8b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.306+0000 7f6e8b7fe640 10 monclient(hunting): handle_auth_done global_id 4128 payload 274 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.307+0000 7f6e8b7fe640 1 -- 172.21.15.173:0/2922470603 >> v2:172.21.15.173:3300/0 conn(0x7f6e8c071000 msgr2=0x7f6e8c13cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.307+0000 7f6e8b7fe640 1 --2- 172.21.15.173:0/2922470603 >> v2:172.21.15.173:3300/0 conn(0x7f6e8c071000 0x7f6e8c13cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.307+0000 7f6e8b7fe640 1 -- 172.21.15.173:0/2922470603 >> v1:172.21.15.173:6789/0 conn(0x7f6e8c13f850 legacy=0x7f6e8c13fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.307+0000 7f6e8b7fe640 10 monclient: _finish_hunting 0 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.307+0000 7f6e8b7fe640 1 monclient: found mon.noname-a 2024-04-09T12:04:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.307+0000 7f6e8b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:22.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.307+0000 7f6e8b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:04:22.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.307+0000 7f6e8b7fe640 1 -- 172.21.15.173:0/2922470603 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c070bb0 con 0x7f6e8c06fd80 2024-04-09T12:04:22.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.309+0000 7f6e8b7fe640 1 --2- 172.21.15.173:0/2922470603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e8c06fd80 0x7f6e8c13c740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c06d8b0 tx=0x7f6e7c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd1b2098cba0c23 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:22.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.311+0000 7f6e8a7fc640 1 -- 172.21.15.173:0/2922470603 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c031710 con 0x7f6e8c06fd80 2024-04-09T12:04:22.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.311+0000 7f6e8a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.311+0000 7f6e8a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.311+0000 7f6e8a7fc640 10 monclient: dump: 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.311+0000 7f6e8a7fc640 10 monclient: _finish_auth 0 2024-04-09T12:04:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.311+0000 7f6e8a7fc640 10 monclient: _check_auth_tickets 2024-04-09T12:04:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.311+0000 7f6e8a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.311+0000 7f6e92245640 5 monclient: authenticate success, global_id 4128 2024-04-09T12:04:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.311+0000 7f6e92245640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:22.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e8a7fc640 1 -- 172.21.15.173:0/2922470603 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c02f050 con 0x7f6e8c06fd80 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e8a7fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e8a7fc640 1 -- 172.21.15.173:0/2922470603 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c031a90 con 0x7f6e8c06fd80 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e92245640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e92245640 4 set_mon_vals no callback set 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e8a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e8a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e8a7fc640 10 monclient: dump: 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e92245640 10 monclient: shutdown 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e92245640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e92245640 1 -- 172.21.15.173:0/2922470603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e8c06fd80 msgr2=0x7f6e8c13c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.313+0000 7f6e92245640 1 --2- 172.21.15.173:0/2922470603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e8c06fd80 0x7f6e8c13c740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c06d8b0 tx=0x7f6e7c02b7b0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.314+0000 7f6e92245640 1 -- 172.21.15.173:0/2922470603 shutdown_connections 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.314+0000 7f6e92245640 1 --2- 172.21.15.173:0/2922470603 >> v2:172.21.15.173:3300/0 conn(0x7f6e8c071000 0x7f6e8c13cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.314+0000 7f6e92245640 1 --2- 172.21.15.173:0/2922470603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e8c06fd80 0x7f6e8c13c740 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.314+0000 7f6e92245640 1 -- 172.21.15.173:0/2922470603 >> 172.21.15.173:0/2922470603 conn(0x7f6e8c0b5140 msgr2=0x7f6e8c0b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.314+0000 7f6e92245640 1 -- 172.21.15.173:0/2922470603 shutdown_connections 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.314+0000 7f6e92245640 1 -- 172.21.15.173:0/2922470603 wait complete. 2024-04-09T12:04:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.314+0000 7f6e92245640 10 monclient: build_initial_monmap 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.314+0000 7f6e92245640 10 monclient: monmap: 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 librados: starting msgr at 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 librados: starting objecter 2024-04-09T12:04:22.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 Processor -- start 2024-04-09T12:04:22.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 -- start start 2024-04-09T12:04:22.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 librados: setting wanted keys 2024-04-09T12:04:22.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 librados: calling monclient init 2024-04-09T12:04:22.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 10 monclient: init 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e8c06fd80 0x7f6e8c1314a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 10 monclient(hunting): picked mon.noname-c con 0x7f6e8c06fd80 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e8c071000 0x7f6e8c0b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 10 monclient(hunting): picked mon.noname-b con 0x7f6e8c071000 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e8c13f850 0x7f6e8c12f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 10 monclient(hunting): picked mon.noname-a con 0x7f6e8c13f850 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c06a180 con 0x7f6e8c13f850 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:22.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c06b600 con 0x7f6e8c071000 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c06b870 con 0x7f6e8c06fd80 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.315+0000 7f6e92245640 10 monclient(hunting): authenticate will time out at 1341.602976s 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e8c13f850 0x7f6e8c12f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e8c071000 0x7f6e8c0b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e8c06fd80 0x7f6e8c1314a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e8c13f850 0x7f6e8c12f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.173:54652/0 (socket says 172.21.15.173:54652) 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8bfff640 1 -- 172.21.15.173:0/2162201489 learned_addr learned my addr 172.21.15.173:0/2162201489 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8bfff640 10 monclient(hunting): get_auth_request con 0x7f6e8c13f850 auth_method 0 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8bfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:22.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8affd640 10 monclient(hunting): get_auth_request con 0x7f6e8c071000 auth_method 0 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.316+0000 7f6e8affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8b7fe640 10 monclient(hunting): get_auth_request con 0x7f6e8c06fd80 auth_method 0 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.317+0000 7f6e8b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.319+0000 7f6e8affd640 10 monclient(hunting): handle_auth_done global_id 4144 payload 824 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.319+0000 7f6e8affd640 1 -- 172.21.15.173:0/2162201489 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e8c06fd80 msgr2=0x7f6e8c1314a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.319+0000 7f6e8affd640 1 --2- 172.21.15.173:0/2162201489 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e8c06fd80 0x7f6e8c1314a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.319+0000 7f6e8affd640 1 -- 172.21.15.173:0/2162201489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e8c13f850 msgr2=0x7f6e8c12f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.319+0000 7f6e8affd640 1 --2- 172.21.15.173:0/2162201489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e8c13f850 0x7f6e8c12f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.319+0000 7f6e8affd640 10 monclient: _finish_hunting 0 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.319+0000 7f6e8affd640 1 monclient: found mon.noname-b 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.319+0000 7f6e8affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.319+0000 7f6e8affd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:04:22.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.319+0000 7f6e8affd640 1 -- 172.21.15.173:0/2162201489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c009400 con 0x7f6e8c071000 2024-04-09T12:04:22.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.322+0000 7f6e8affd640 1 --2- 172.21.15.173:0/2162201489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e8c071000 0x7f6e8c0b3020 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000e850 tx=0x7f6e8000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:22.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.322+0000 7f6e73fff640 10 client.?.objecter ms_handle_connect 0x7f6e8c071000 2024-04-09T12:04:22.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.322+0000 7f6e73fff640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:22.328 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:22.324+0000 7f1d2f23b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-09T12:04:22.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 1 -- 172.21.15.173:0/2162201489 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8000c940 con 0x7f6e8c071000 2024-04-09T12:04:22.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:22.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:04:22.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 10 monclient: dump: 2024-04-09T12:04:22.329 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:22.329 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:22.329 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.329 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.329 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:22.329 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.329 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 10 monclient: _finish_auth 0 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 10 monclient: _check_auth_tickets 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 1 -- 172.21.15.173:0/2162201489 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8000caa0 con 0x7f6e8c071000 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e92245640 5 monclient: authenticate success, global_id 4144 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 1 -- 172.21.15.173:0/2162201489 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8000ce10 con 0x7f6e8c071000 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e92245640 10 monclient: _renew_subs 2024-04-09T12:04:22.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e92245640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e92245640 1 -- 172.21.15.173:0/2162201489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c06bb50 con 0x7f6e8c071000 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e73fff640 10 monclient: dump: 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:22.331 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e89ffb640 4 set_mon_vals no callback set 2024-04-09T12:04:22.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e92245640 10 client.4144.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:22.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e92245640 10 monclient: _renew_subs 2024-04-09T12:04:22.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e92245640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:22.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e92245640 1 -- 172.21.15.173:0/2162201489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c0ae790 con 0x7f6e8c071000 2024-04-09T12:04:22.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.326+0000 7f6e92245640 1 librados: init done 2024-04-09T12:04:22.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.327+0000 7f6e92245640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:22.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.327+0000 7f6e92245640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:22.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.327+0000 7f6e92245640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:22.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.327+0000 7f6e92245640 1 -- 172.21.15.173:0/2162201489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c06a2f0 con 0x7f6e8c071000 2024-04-09T12:04:22.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.331+0000 7f6e73fff640 1 -- 172.21.15.173:0/2162201489 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6e80005c90 con 0x7f6e8c071000 2024-04-09T12:04:22.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.331+0000 7f6e73fff640 1 -- 172.21.15.173:0/2162201489 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f6e80006840 con 0x7f6e8c071000 2024-04-09T12:04:22.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.331+0000 7f6e73fff640 10 client.4144.objecter ms_dispatch 0x7f6e8c000b90 osd_map(6..6 src has 1..6) v4 2024-04-09T12:04:22.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.331+0000 7f6e73fff640 3 client.4144.objecter handle_osd_map got epochs [6,6] > 0 2024-04-09T12:04:22.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.331+0000 7f6e73fff640 3 client.4144.objecter handle_osd_map decoding full epoch 6 2024-04-09T12:04:22.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.331+0000 7f6e73fff640 20 client.4144.objecter dump_active .. 0 homeless 2024-04-09T12:04:22.393 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:22.390+0000 7f6d5fa0f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-09T12:04:22.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.452+0000 7f6e73fff640 1 -- 172.21.15.173:0/2162201489 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72706 (secure 0 0 0) 0x7f6e80021060 con 0x7f6e8c071000 2024-04-09T12:04:22.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.452+0000 7f6e73fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:22.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.452+0000 7f6e73fff640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:22.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.523+0000 7f6e92245640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7f553202-73e9-496c-893f-185c61f66807", "id": 4}] 2024-04-09T12:04:22.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.523+0000 7f6e92245640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7f553202-73e9-496c-893f-185c61f66807", "id": 4}] 2024-04-09T12:04:22.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.523+0000 7f6e92245640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:22.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.523+0000 7f6e92245640 1 -- 172.21.15.173:0/2162201489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7f553202-73e9-496c-893f-185c61f66807", "id": 4} v 0) v1 -- 0x7f6e8c04e160 con 0x7f6e8c071000 2024-04-09T12:04:22.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.591+0000 7f6e73fff640 1 -- 172.21.15.173:0/2162201489 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f553202-73e9-496c-893f-185c61f66807", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6e80017070 con 0x7f6e8c071000 2024-04-09T12:04:22.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.591+0000 7f6e73fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7f553202-73e9-496c-893f-185c61f66807", "id": 4}] 2024-04-09T12:04:22.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.591+0000 7f6e73fff640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:22.594 INFO:teuthology.orchestra.run.smithi173.stdout:4 2024-04-09T12:04:22.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 10 librados: watch_flush enter 2024-04-09T12:04:22.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 10 librados: watch_flush exit 2024-04-09T12:04:22.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 20 client.4144.objecter shutdown clearing up homeless session... 2024-04-09T12:04:22.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 10 client.4144.objecter successfully canceled tick 2024-04-09T12:04:22.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 10 monclient: shutdown 2024-04-09T12:04:22.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:22.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 1 -- 172.21.15.173:0/2162201489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e8c071000 msgr2=0x7f6e8c0b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:22.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 1 --2- 172.21.15.173:0/2162201489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e8c071000 0x7f6e8c0b3020 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000e850 tx=0x7f6e8000ed10 comp rx=0 tx=0).stop 2024-04-09T12:04:22.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 1 -- 172.21.15.173:0/2162201489 shutdown_connections 2024-04-09T12:04:22.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 1 --2- 172.21.15.173:0/2162201489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e8c13f850 0x7f6e8c12f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 1 --2- 172.21.15.173:0/2162201489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e8c071000 0x7f6e8c0b3020 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 1 --2- 172.21.15.173:0/2162201489 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e8c06fd80 0x7f6e8c1314a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 1 -- 172.21.15.173:0/2162201489 >> 172.21.15.173:0/2162201489 conn(0x7f6e8c0b5140 msgr2=0x7f6e8c132950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:22.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 1 -- 172.21.15.173:0/2162201489 shutdown_connections 2024-04-09T12:04:22.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 1 -- 172.21.15.173:0/2162201489 wait complete. 2024-04-09T12:04:22.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.592+0000 7f6e92245640 1 librados: shutdown 2024-04-09T12:04:22.604 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 84050623-d3f3-40ba-b63e-92d56a74bfd6 5 2024-04-09T12:04:22.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.700+0000 7f471153d640 10 monclient: get_monmap_and_config 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.700+0000 7f471153d640 10 monclient: build_initial_monmap 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.700+0000 7f471153d640 10 monclient: monmap: 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:04:22.701716+0000 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:04:22.701716+0000 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:22.704 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:22.705 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:22.705 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.700+0000 7f471153d640 1 Processor -- start 2024-04-09T12:04:22.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 1 -- start start 2024-04-09T12:04:22.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 10 monclient: init 2024-04-09T12:04:22.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:22.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2024-04-09T12:04:22.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f470c0a8a80 0x7f470c0a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:22.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 10 monclient(hunting): picked mon.noname-c con 0x7f470c0a8a80 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:22.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f470c0a93a0 0x7f470c145140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:22.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 10 monclient(hunting): picked mon.noname-b con 0x7f470c0a93a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:22.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f470c145680 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:22.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470c0b7b80 con 0x7f470c145680 2024-04-09T12:04:22.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:22.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c145af0 con 0x7f470c0a8a80 2024-04-09T12:04:22.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:22.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c144c20 con 0x7f470c0a93a0 2024-04-09T12:04:22.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.701+0000 7f471153d640 10 monclient(hunting): authenticate will time out at 1341.989740s 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470affd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f470c0a8a80 0x7f470c0a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470a7fc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f470c0a93a0 0x7f470c145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470affd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f470c0a8a80 0x7f470c0a8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57180/0 (socket says 172.21.15.173:57180) 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470affd640 1 -- 172.21.15.173:0/589152153 learned_addr learned my addr 172.21.15.173:0/589152153 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470affd640 10 monclient(hunting): get_auth_request con 0x7f470c0a8a80 auth_method 0 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470a7fc640 10 monclient(hunting): get_auth_request con 0x7f470c0a93a0 auth_method 0 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:22.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.702+0000 7f470a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.703+0000 7f470a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.703+0000 7f470a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.703+0000 7f470a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.703+0000 7f470affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.703+0000 7f470affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.703+0000 7f470affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.705+0000 7f470a7fc640 10 monclient(hunting): handle_auth_done global_id 4133 payload 274 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.705+0000 7f470a7fc640 1 -- 172.21.15.173:0/589152153 >> v2:172.21.15.173:3300/0 conn(0x7f470c0a8a80 msgr2=0x7f470c0a8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.705+0000 7f470a7fc640 1 --2- 172.21.15.173:0/589152153 >> v2:172.21.15.173:3300/0 conn(0x7f470c0a8a80 0x7f470c0a8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.705+0000 7f470a7fc640 1 -- 172.21.15.173:0/589152153 >> v1:172.21.15.173:6789/0 conn(0x7f470c145680 legacy=0x7f470c13e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.705+0000 7f470a7fc640 10 monclient: _finish_hunting 0 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.705+0000 7f470a7fc640 1 monclient: found mon.noname-b 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.705+0000 7f470a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:22.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.705+0000 7f470a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:04:22.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.705+0000 7f470a7fc640 1 -- 172.21.15.173:0/589152153 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c0b1a60 con 0x7f470c0a93a0 2024-04-09T12:04:22.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.707+0000 7f470a7fc640 1 --2- 172.21.15.173:0/589152153 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f470c0a93a0 0x7f470c145140 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f47000097a0 tx=0x7f470002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c36ce12134b04f7c server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:22.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 1 -- 172.21.15.173:0/589152153 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700031830 con 0x7f470c0a93a0 2024-04-09T12:04:22.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:22.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:04:22.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 10 monclient: dump: 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 10 monclient: _finish_auth 0 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 1 -- 172.21.15.173:0/589152153 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4700031990 con 0x7f470c0a93a0 2024-04-09T12:04:22.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f471153d640 5 monclient: authenticate success, global_id 4133 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f471153d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f471153d640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f471153d640 4 set_mon_vals no callback set 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 1 -- 172.21.15.173:0/589152153 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700031d20 con 0x7f470c0a93a0 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.710+0000 7f4709ffb640 10 monclient: dump: 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.717 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.711+0000 7f471153d640 10 monclient: shutdown 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.711+0000 7f471153d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.711+0000 7f471153d640 1 -- 172.21.15.173:0/589152153 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f470c0a93a0 msgr2=0x7f470c145140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.711+0000 7f471153d640 1 --2- 172.21.15.173:0/589152153 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f470c0a93a0 0x7f470c145140 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f47000097a0 tx=0x7f470002b8d0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.711+0000 7f471153d640 1 -- 172.21.15.173:0/589152153 shutdown_connections 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.711+0000 7f471153d640 1 --2- 172.21.15.173:0/589152153 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f470c0a93a0 0x7f470c145140 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.711+0000 7f471153d640 1 --2- 172.21.15.173:0/589152153 >> v2:172.21.15.173:3300/0 conn(0x7f470c0a8a80 0x7f470c0a8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.711+0000 7f471153d640 1 -- 172.21.15.173:0/589152153 >> 172.21.15.173:0/589152153 conn(0x7f470c0b7060 msgr2=0x7f470c0b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.711+0000 7f471153d640 1 -- 172.21.15.173:0/589152153 shutdown_connections 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.711+0000 7f471153d640 1 -- 172.21.15.173:0/589152153 wait complete. 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.712+0000 7f471153d640 10 monclient: build_initial_monmap 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.712+0000 7f471153d640 10 monclient: monmap: 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:22.719 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.712+0000 7f471153d640 1 librados: starting msgr at 2024-04-09T12:04:22.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.712+0000 7f471153d640 1 librados: starting objecter 2024-04-09T12:04:22.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.712+0000 7f471153d640 1 Processor -- start 2024-04-09T12:04:22.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.712+0000 7f471153d640 1 -- start start 2024-04-09T12:04:22.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.712+0000 7f471153d640 1 librados: setting wanted keys 2024-04-09T12:04:22.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.712+0000 7f471153d640 1 librados: calling monclient init 2024-04-09T12:04:22.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.712+0000 7f471153d640 10 monclient: init 2024-04-09T12:04:22.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:22.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-09T12:04:22.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f470c0a8a80 0x7f470c137700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:22.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 10 monclient(hunting): picked mon.noname-c con 0x7f470c0a8a80 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:22.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f470c0a93a0 0x7f470c139900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:22.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 10 monclient(hunting): picked mon.noname-a con 0x7f470c0a93a0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:22.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c145680 0x7f470c139e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:22.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 10 monclient(hunting): picked mon.noname-b con 0x7f470c145680 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:22.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c1392e0 con 0x7f470c0a93a0 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c141450 con 0x7f470c145680 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c1394e0 con 0x7f470c0a8a80 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f471153d640 10 monclient(hunting): authenticate will time out at 1342.001566s 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.713+0000 7f470b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c145680 0x7f470c139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470affd640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f470c0a8a80 0x7f470c137700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f470c0a93a0 0x7f470c139900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c145680 0x7f470c139e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57182/0 (socket says 172.21.15.173:57182) 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470b7fe640 1 -- 172.21.15.173:0/1895752605 learned_addr learned my addr 172.21.15.173:0/1895752605 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470b7fe640 10 monclient(hunting): get_auth_request con 0x7f470c145680 auth_method 0 2024-04-09T12:04:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f470c0a93a0 0x7f470c139900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.173:54656/0 (socket says 172.21.15.173:54656) 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470a7fc640 10 monclient(hunting): get_auth_request con 0x7f470c0a93a0 auth_method 0 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470affd640 10 monclient(hunting): get_auth_request con 0x7f470c0a8a80 auth_method 0 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.714+0000 7f470a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.715+0000 7f470affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.715+0000 7f470affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.715+0000 7f470affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.717+0000 7f470b7fe640 10 monclient(hunting): handle_auth_done global_id 4153 payload 824 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.717+0000 7f470b7fe640 1 -- 172.21.15.173:0/1895752605 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f470c0a8a80 msgr2=0x7f470c137700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.717+0000 7f470b7fe640 1 --2- 172.21.15.173:0/1895752605 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f470c0a8a80 0x7f470c137700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.717+0000 7f470b7fe640 1 -- 172.21.15.173:0/1895752605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f470c0a93a0 msgr2=0x7f470c139900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.717+0000 7f470b7fe640 1 --2- 172.21.15.173:0/1895752605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f470c0a93a0 0x7f470c139900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.717+0000 7f470b7fe640 10 monclient: _finish_hunting 0 2024-04-09T12:04:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.717+0000 7f470b7fe640 1 monclient: found mon.noname-b 2024-04-09T12:04:22.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.717+0000 7f470b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:22.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.717+0000 7f470b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:04:22.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.717+0000 7f470b7fe640 1 -- 172.21.15.173:0/1895752605 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4700009400 con 0x7f470c145680 2024-04-09T12:04:22.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.719+0000 7f470b7fe640 1 --2- 172.21.15.173:0/1895752605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c145680 0x7f470c139e40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f470400c7a0 tx=0x7f470400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:22.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.719+0000 7f46f37fe640 10 client.?.objecter ms_handle_connect 0x7f470c145680 2024-04-09T12:04:22.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.719+0000 7f46f37fe640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 1 -- 172.21.15.173:0/1895752605 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704003b70 con 0x7f470c145680 2024-04-09T12:04:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 10 monclient: dump: 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 10 monclient: _finish_auth 0 2024-04-09T12:04:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 10 monclient: _check_auth_tickets 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 1 -- 172.21.15.173:0/1895752605 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4704003cf0 con 0x7f470c145680 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f471153d640 5 monclient: authenticate success, global_id 4153 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f471153d640 10 monclient: _renew_subs 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f471153d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f471153d640 1 -- 172.21.15.173:0/1895752605 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470c138080 con 0x7f470c145680 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 1 -- 172.21.15.173:0/1895752605 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704003ea0 con 0x7f470c145680 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f46f37fe640 10 monclient: dump: 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:22.730 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f47097fa640 4 set_mon_vals no callback set 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f471153d640 10 client.4153.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f471153d640 10 monclient: _renew_subs 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f471153d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f471153d640 1 -- 172.21.15.173:0/1895752605 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c137c40 con 0x7f470c145680 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.723+0000 7f471153d640 1 librados: init done 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.724+0000 7f471153d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.724+0000 7f471153d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.724+0000 7f471153d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.724+0000 7f471153d640 1 -- 172.21.15.173:0/1895752605 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470c14bef0 con 0x7f470c145680 2024-04-09T12:04:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.727+0000 7f46f37fe640 1 -- 172.21.15.173:0/1895752605 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f47040050d0 con 0x7f470c145680 2024-04-09T12:04:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.727+0000 7f46f37fe640 1 -- 172.21.15.173:0/1895752605 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f47040259b0 con 0x7f470c145680 2024-04-09T12:04:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.727+0000 7f46f37fe640 10 client.4153.objecter ms_dispatch 0x7f470c000b90 osd_map(7..7 src has 1..7) v4 2024-04-09T12:04:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.727+0000 7f46f37fe640 3 client.4153.objecter handle_osd_map got epochs [7,7] > 0 2024-04-09T12:04:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.727+0000 7f46f37fe640 3 client.4153.objecter handle_osd_map decoding full epoch 7 2024-04-09T12:04:22.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.727+0000 7f46f37fe640 20 client.4153.objecter dump_active .. 0 homeless 2024-04-09T12:04:22.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.824+0000 7f46f37fe640 1 -- 172.21.15.173:0/1895752605 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72706 (secure 0 0 0) 0x7f470c14bef0 con 0x7f470c145680 2024-04-09T12:04:22.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.824+0000 7f46f37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:22.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.824+0000 7f46f37fe640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:22.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.895+0000 7f471153d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "84050623-d3f3-40ba-b63e-92d56a74bfd6", "id": 5}] 2024-04-09T12:04:22.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.895+0000 7f471153d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "84050623-d3f3-40ba-b63e-92d56a74bfd6", "id": 5}] 2024-04-09T12:04:22.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.895+0000 7f471153d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:22.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.895+0000 7f471153d640 1 -- 172.21.15.173:0/1895752605 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "84050623-d3f3-40ba-b63e-92d56a74bfd6", "id": 5} v 0) v1 -- 0x7f470c04e160 con 0x7f470c145680 2024-04-09T12:04:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.981+0000 7f46f37fe640 1 -- 172.21.15.173:0/1895752605 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84050623-d3f3-40ba-b63e-92d56a74bfd6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4704025cf0 con 0x7f470c145680 2024-04-09T12:04:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.981+0000 7f46f37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "84050623-d3f3-40ba-b63e-92d56a74bfd6", "id": 5}] 2024-04-09T12:04:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.981+0000 7f46f37fe640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:22.985 INFO:teuthology.orchestra.run.smithi173.stdout:5 2024-04-09T12:04:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 10 librados: watch_flush enter 2024-04-09T12:04:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 10 librados: watch_flush exit 2024-04-09T12:04:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 20 client.4153.objecter shutdown clearing up homeless session... 2024-04-09T12:04:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 10 client.4153.objecter successfully canceled tick 2024-04-09T12:04:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 10 monclient: shutdown 2024-04-09T12:04:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 1 -- 172.21.15.173:0/1895752605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c145680 msgr2=0x7f470c139e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 1 --2- 172.21.15.173:0/1895752605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c145680 0x7f470c139e40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f470400c7a0 tx=0x7f470400cc60 comp rx=0 tx=0).stop 2024-04-09T12:04:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 1 -- 172.21.15.173:0/1895752605 shutdown_connections 2024-04-09T12:04:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 1 --2- 172.21.15.173:0/1895752605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c145680 0x7f470c139e40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 1 --2- 172.21.15.173:0/1895752605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f470c0a93a0 0x7f470c139900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 1 --2- 172.21.15.173:0/1895752605 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f470c0a8a80 0x7f470c137700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 1 -- 172.21.15.173:0/1895752605 >> 172.21.15.173:0/1895752605 conn(0x7f470c0b7060 msgr2=0x7f470c1369e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 1 -- 172.21.15.173:0/1895752605 shutdown_connections 2024-04-09T12:04:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 1 -- 172.21.15.173:0/1895752605 wait complete. 2024-04-09T12:04:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:22.982+0000 7f471153d640 1 librados: shutdown 2024-04-09T12:04:22.999 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 883e841f-8acc-4268-8e64-c556b10befa5 6 2024-04-09T12:04:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.096+0000 7f897f42a640 10 monclient: get_monmap_and_config 2024-04-09T12:04:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.096+0000 7f897f42a640 10 monclient: build_initial_monmap 2024-04-09T12:04:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.096+0000 7f897f42a640 10 monclient: monmap: 2024-04-09T12:04:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:04:23.097426+0000 2024-04-09T12:04:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:04:23.097426+0000 2024-04-09T12:04:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:23.100 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:23.100 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:23.100 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:23.100 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.096+0000 7f897f42a640 1 Processor -- start 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 1 -- start start 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 10 monclient: init 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f89780737b0 0x7f897813e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 10 monclient(hunting): picked mon.noname-a con 0x7f89780737b0 addr v2:172.21.15.29:3300/0 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f89780ae1b0 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f897813ec50 0x7f89781452e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 10 monclient(hunting): picked mon.noname-c con 0x7f897813ec50 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89780ae7f0 con 0x7f89780ae1b0 2024-04-09T12:04:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8978145820 con 0x7f89780737b0 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89780aec80 con 0x7f897813ec50 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.097+0000 7f897f42a640 10 monclient(hunting): authenticate will time out at 1342.385884s 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.098+0000 7f897d9c7640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f897813ec50 0x7f89781452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.098+0000 7f897c9c5640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f89780ae1b0 0x7f8978144bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56108/0 (socket says 172.21.15.173:56108) 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.098+0000 7f897c9c5640 1 -- 172.21.15.173:0/3970406750 learned_addr learned my addr 172.21.15.173:0/3970406750 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.099+0000 7f897d9c7640 10 monclient(hunting): get_auth_request con 0x7f897813ec50 auth_method 0 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.099+0000 7f897d9c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.099+0000 7f897d9c7640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.099+0000 7f897d9c7640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:23.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.100+0000 7f897d9c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:23.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.100+0000 7f897d9c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:23.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.100+0000 7f897d9c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:23.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.102+0000 7f897d9c7640 10 monclient(hunting): handle_auth_done global_id 4156 payload 274 2024-04-09T12:04:23.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.102+0000 7f897d9c7640 1 -- 172.21.15.173:0/3970406750 >> v2:172.21.15.29:3300/0 conn(0x7f89780737b0 msgr2=0x7f897813e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:23.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.102+0000 7f897d9c7640 1 --2- 172.21.15.173:0/3970406750 >> v2:172.21.15.29:3300/0 conn(0x7f89780737b0 0x7f897813e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.102+0000 7f897d9c7640 1 -- 172.21.15.173:0/3970406750 >> v1:172.21.15.173:6789/0 conn(0x7f89780ae1b0 legacy=0x7f8978144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:23.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.102+0000 7f897d9c7640 10 monclient: _finish_hunting 0 2024-04-09T12:04:23.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.102+0000 7f897d9c7640 1 monclient: found mon.noname-c 2024-04-09T12:04:23.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.102+0000 7f897d9c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:23.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.102+0000 7f897d9c7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:04:23.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.102+0000 7f897d9c7640 1 -- 172.21.15.173:0/3970406750 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897806e460 con 0x7f897813ec50 2024-04-09T12:04:23.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.107+0000 7f897d9c7640 1 --2- 172.21.15.173:0/3970406750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897813ec50 0x7f89781452e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f89780ae690 tx=0x7f897002be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e19ea096e40b2891 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:23.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.117+0000 7f896ffff640 1 -- 172.21.15.173:0/3970406750 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897002cbf0 con 0x7f897813ec50 2024-04-09T12:04:23.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.117+0000 7f896ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:23.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.117+0000 7f896ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.117+0000 7f896ffff640 10 monclient: dump: 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.117+0000 7f896ffff640 10 monclient: _finish_auth 0 2024-04-09T12:04:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.117+0000 7f896ffff640 10 monclient: _check_auth_tickets 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.117+0000 7f896ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.117+0000 7f896ffff640 1 -- 172.21.15.173:0/3970406750 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897002cd50 con 0x7f897813ec50 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.117+0000 7f896ffff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 5 monclient: authenticate success, global_id 4156 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.117+0000 7f896ffff640 1 -- 172.21.15.173:0/3970406750 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970034660 con 0x7f897813ec50 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f896ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f896ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f896ffff640 10 monclient: dump: 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:23.123 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.123 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:23.123 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:23.123 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:23.123 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:23.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 4 set_mon_vals no callback set 2024-04-09T12:04:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 10 monclient: shutdown 2024-04-09T12:04:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 1 -- 172.21.15.173:0/3970406750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897813ec50 msgr2=0x7f89781452e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 1 --2- 172.21.15.173:0/3970406750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897813ec50 0x7f89781452e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f89780ae690 tx=0x7f897002be40 comp rx=0 tx=0).stop 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 1 -- 172.21.15.173:0/3970406750 shutdown_connections 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 1 --2- 172.21.15.173:0/3970406750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897813ec50 0x7f89781452e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 1 --2- 172.21.15.173:0/3970406750 >> v2:172.21.15.29:3300/0 conn(0x7f89780737b0 0x7f897813e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 1 -- 172.21.15.173:0/3970406750 >> 172.21.15.173:0/3970406750 conn(0x7f89780b3f50 msgr2=0x7f8978069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 1 -- 172.21.15.173:0/3970406750 shutdown_connections 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.118+0000 7f897f42a640 1 -- 172.21.15.173:0/3970406750 wait complete. 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.119+0000 7f897f42a640 10 monclient: build_initial_monmap 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.119+0000 7f897f42a640 10 monclient: monmap: 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-04-09T12:04:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.119+0000 7f897f42a640 1 librados: starting msgr at 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.119+0000 7f897f42a640 1 librados: starting objecter 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.119+0000 7f897f42a640 1 Processor -- start 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 1 -- start start 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 1 librados: setting wanted keys 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 1 librados: calling monclient init 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 10 monclient: init 2024-04-09T12:04:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89780737b0 0x7f897813fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 10 monclient(hunting): picked mon.noname-b con 0x7f89780737b0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89780ae1b0 0x7f897813c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 10 monclient(hunting): picked mon.noname-c con 0x7f89780ae1b0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897813ec50 0x7f897813c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 10 monclient(hunting): picked mon.noname-a con 0x7f897813ec50 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89781375e0 con 0x7f897813ec50 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8978142060 con 0x7f89780737b0 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897813dce0 con 0x7f89780ae1b0 2024-04-09T12:04:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.120+0000 7f897f42a640 10 monclient(hunting): authenticate will time out at 1342.408632s 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.121+0000 7f897d9c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897813ec50 0x7f897813c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.121+0000 7f897d9c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897813ec50 0x7f897813c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.173:54678/0 (socket says 172.21.15.173:54678) 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.121+0000 7f897d9c7640 1 -- 172.21.15.173:0/2721777043 learned_addr learned my addr 172.21.15.173:0/2721777043 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.121+0000 7f897d9c7640 10 monclient(hunting): get_auth_request con 0x7f897813ec50 auth_method 0 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.121+0000 7f897d9c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.121+0000 7f897d9c7640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.121+0000 7f897d9c7640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.121+0000 7f897c9c5640 1 --2- 172.21.15.173:0/2721777043 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89780ae1b0 0x7f897813c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.121+0000 7f897d9c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.121+0000 7f897d9c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.121+0000 7f897d9c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.122+0000 7f897d1c6640 1 --2- 172.21.15.173:0/2721777043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89780737b0 0x7f897813fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.122+0000 7f897c9c5640 10 monclient(hunting): get_auth_request con 0x7f89780ae1b0 auth_method 0 2024-04-09T12:04:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.122+0000 7f897c9c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.122+0000 7f897c9c5640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.122+0000 7f897c9c5640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.122+0000 7f897d1c6640 10 monclient(hunting): get_auth_request con 0x7f89780737b0 auth_method 0 2024-04-09T12:04:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.122+0000 7f897d1c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.122+0000 7f897d1c6640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.122+0000 7f897d1c6640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.123+0000 7f897d1c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.123+0000 7f897d1c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.123+0000 7f897d1c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:23.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.124+0000 7f897d9c7640 10 monclient(hunting): handle_auth_done global_id 4137 payload 824 2024-04-09T12:04:23.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.124+0000 7f897d9c7640 1 -- 172.21.15.173:0/2721777043 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89780ae1b0 msgr2=0x7f897813c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.124+0000 7f897d9c7640 1 --2- 172.21.15.173:0/2721777043 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89780ae1b0 0x7f897813c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.124+0000 7f897d9c7640 1 -- 172.21.15.173:0/2721777043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89780737b0 msgr2=0x7f897813fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.124+0000 7f897d9c7640 1 --2- 172.21.15.173:0/2721777043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89780737b0 0x7f897813fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.124+0000 7f897d9c7640 10 monclient: _finish_hunting 0 2024-04-09T12:04:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.124+0000 7f897d9c7640 1 monclient: found mon.noname-a 2024-04-09T12:04:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.124+0000 7f897d9c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.124+0000 7f897d9c7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:04:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.124+0000 7f897d9c7640 1 -- 172.21.15.173:0/2721777043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970009a70 con 0x7f897813ec50 2024-04-09T12:04:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.127+0000 7f897d9c7640 1 --2- 172.21.15.173:0/2721777043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897813ec50 0x7f897813c5d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f897002c450 tx=0x7f8970004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.127+0000 7f896dffb640 10 client.?.objecter ms_handle_connect 0x7f897813ec50 2024-04-09T12:04:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.127+0000 7f896dffb640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 1 -- 172.21.15.173:0/2721777043 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897003e610 con 0x7f897813ec50 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 10 monclient: dump: 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 10 monclient: _finish_auth 0 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 10 monclient: _check_auth_tickets 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 1 -- 172.21.15.173:0/2721777043 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897003e770 con 0x7f897813ec50 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 1 -- 172.21.15.173:0/2721777043 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897003eb20 con 0x7f897813ec50 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f897f42a640 5 monclient: authenticate success, global_id 4137 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f897f42a640 10 monclient: _renew_subs 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f897f42a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f897f42a640 1 -- 172.21.15.173:0/2721777043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8978140730 con 0x7f897813ec50 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896f7fe640 4 set_mon_vals no callback set 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:04:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.130+0000 7f896dffb640 10 monclient: dump: 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.131+0000 7f897f42a640 10 client.4137.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.131+0000 7f897f42a640 10 monclient: _renew_subs 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.131+0000 7f897f42a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.131+0000 7f897f42a640 1 -- 172.21.15.173:0/2721777043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8978140350 con 0x7f897813ec50 2024-04-09T12:04:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.131+0000 7f897f42a640 1 librados: init done 2024-04-09T12:04:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.132+0000 7f897f42a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.132+0000 7f897f42a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.132+0000 7f897f42a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.132+0000 7f897f42a640 1 -- 172.21.15.173:0/2721777043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8978140570 con 0x7f897813ec50 2024-04-09T12:04:23.199 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:23.196+0000 7f1d2f23b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-09T12:04:23.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.233+0000 7f896dffb640 1 -- 172.21.15.173:0/2721777043 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f897003b050 con 0x7f897813ec50 2024-04-09T12:04:23.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.237+0000 7f896dffb640 1 -- 172.21.15.173:0/2721777043 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f8970053cc0 con 0x7f897813ec50 2024-04-09T12:04:23.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.237+0000 7f896dffb640 10 client.4137.objecter ms_dispatch 0x7f8978000b90 osd_map(8..8 src has 1..8) v4 2024-04-09T12:04:23.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.237+0000 7f896dffb640 3 client.4137.objecter handle_osd_map got epochs [8,8] > 0 2024-04-09T12:04:23.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.237+0000 7f896dffb640 3 client.4137.objecter handle_osd_map decoding full epoch 8 2024-04-09T12:04:23.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.237+0000 7f896dffb640 20 client.4137.objecter dump_active .. 0 homeless 2024-04-09T12:04:23.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.237+0000 7f896dffb640 1 -- 172.21.15.173:0/2721777043 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72706 (secure 0 0 0) 0x7f897004e060 con 0x7f897813ec50 2024-04-09T12:04:23.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.237+0000 7f896dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:23.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.237+0000 7f896dffb640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:23.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.310+0000 7f897f42a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "883e841f-8acc-4268-8e64-c556b10befa5", "id": 6}] 2024-04-09T12:04:23.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.310+0000 7f897f42a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "883e841f-8acc-4268-8e64-c556b10befa5", "id": 6}] 2024-04-09T12:04:23.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.310+0000 7f897f42a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:23.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.310+0000 7f897f42a640 1 -- 172.21.15.173:0/2721777043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "883e841f-8acc-4268-8e64-c556b10befa5", "id": 6} v 0) v1 -- 0x7f8978140920 con 0x7f897813ec50 2024-04-09T12:04:23.323 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:23.320+0000 7f6d5fa0f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-09T12:04:23.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.375+0000 7f896dffb640 1 -- 172.21.15.173:0/2721777043 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "883e841f-8acc-4268-8e64-c556b10befa5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8970057020 con 0x7f897813ec50 2024-04-09T12:04:23.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.375+0000 7f896dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "883e841f-8acc-4268-8e64-c556b10befa5", "id": 6}] 2024-04-09T12:04:23.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.375+0000 7f896dffb640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:23.378 INFO:teuthology.orchestra.run.smithi173.stdout:6 2024-04-09T12:04:23.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 10 librados: watch_flush enter 2024-04-09T12:04:23.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 10 librados: watch_flush exit 2024-04-09T12:04:23.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 20 client.4137.objecter shutdown clearing up homeless session... 2024-04-09T12:04:23.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 10 client.4137.objecter successfully canceled tick 2024-04-09T12:04:23.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 10 monclient: shutdown 2024-04-09T12:04:23.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:23.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 1 -- 172.21.15.173:0/2721777043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897813ec50 msgr2=0x7f897813c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:23.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 1 --2- 172.21.15.173:0/2721777043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897813ec50 0x7f897813c5d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f897002c450 tx=0x7f8970004a40 comp rx=0 tx=0).stop 2024-04-09T12:04:23.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 1 -- 172.21.15.173:0/2721777043 shutdown_connections 2024-04-09T12:04:23.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 1 --2- 172.21.15.173:0/2721777043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897813ec50 0x7f897813c5d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 1 --2- 172.21.15.173:0/2721777043 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89780ae1b0 0x7f897813c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 1 --2- 172.21.15.173:0/2721777043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89780737b0 0x7f897813fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 1 -- 172.21.15.173:0/2721777043 >> 172.21.15.173:0/2721777043 conn(0x7f89780b3f50 msgr2=0x7f8978144d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:23.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 1 -- 172.21.15.173:0/2721777043 shutdown_connections 2024-04-09T12:04:23.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 1 -- 172.21.15.173:0/2721777043 wait complete. 2024-04-09T12:04:23.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.376+0000 7f897f42a640 1 librados: shutdown 2024-04-09T12:04:23.389 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 126085be-23ad-45b6-951d-47886bdfa75c 7 2024-04-09T12:04:23.481 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:23.478+0000 7f1d2f23b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-09T12:04:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.485+0000 7fccccaa4640 10 monclient: get_monmap_and_config 2024-04-09T12:04:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.485+0000 7fccccaa4640 10 monclient: build_initial_monmap 2024-04-09T12:04:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.485+0000 7fccccaa4640 10 monclient: monmap: 2024-04-09T12:04:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:04:23.486534+0000 2024-04-09T12:04:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:04:23.486534+0000 2024-04-09T12:04:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:23.489 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:23.489 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:23.489 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:23.489 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:23.489 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.485+0000 7fccccaa4640 1 Processor -- start 2024-04-09T12:04:23.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.485+0000 7fccccaa4640 1 -- start start 2024-04-09T12:04:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.485+0000 7fccccaa4640 10 monclient: init 2024-04-09T12:04:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2024-04-09T12:04:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fccc80b42f0 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fccc8141660 0x7fccc8141a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 10 monclient(hunting): picked mon.noname-a con 0x7fccc8141660 addr v2:172.21.15.29:3300/0 2024-04-09T12:04:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fccc813e7f0 0x7fccc813ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 10 monclient(hunting): picked mon.noname-b con 0x7fccc813e7f0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc80aa450 con 0x7fccc80b42f0 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc80b46d0 con 0x7fccc8141660 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc80aa730 con 0x7fccc813e7f0 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.486+0000 7fccccaa4640 10 monclient(hunting): authenticate will time out at 1342.774745s 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc659c640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fccc80b42f0 0x7fccc80a88a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38048/0 (socket says 172.21.15.173:38048) 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc659c640 1 -- 172.21.15.173:0/2798720929 learned_addr learned my addr 172.21.15.173:0/2798720929 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc5d9b640 1 --2- 172.21.15.173:0/2798720929 >> v2:172.21.15.29:3300/0 conn(0x7fccc8141660 0x7fccc8141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc6d9d640 1 --2- 172.21.15.173:0/2798720929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fccc813e7f0 0x7fccc813ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc5d9b640 10 monclient(hunting): get_auth_request con 0x7fccc8141660 auth_method 0 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:23.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:23.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc6d9d640 10 monclient(hunting): get_auth_request con 0x7fccc813e7f0 auth_method 0 2024-04-09T12:04:23.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:23.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc6d9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:23.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.487+0000 7fccc6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:23.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.488+0000 7fccc5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:23.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.488+0000 7fccc5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:23.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.488+0000 7fccc5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:23.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.488+0000 7fccc6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:23.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.488+0000 7fccc6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:23.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.488+0000 7fccc6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc559a640 1 -- 172.21.15.173:0/2798720929 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780445994 0 0) 0x7fccc80aa450 con 0x7fccc80b42f0 2024-04-09T12:04:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc559a640 10 monclient(hunting): _negotiate 2024-04-09T12:04:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc559a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc559a640 10 monclient(hunting): my global_id is 4165 2024-04-09T12:04:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc559a640 1 -- 172.21.15.173:0/2798720929 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccb0003520 con 0x7fccc80b42f0 2024-04-09T12:04:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc5d9b640 10 monclient(hunting): handle_auth_done global_id 4140 payload 274 2024-04-09T12:04:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc5d9b640 1 -- 172.21.15.173:0/2798720929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fccc813e7f0 msgr2=0x7fccc813ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc5d9b640 1 --2- 172.21.15.173:0/2798720929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fccc813e7f0 0x7fccc813ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc5d9b640 1 -- 172.21.15.173:0/2798720929 >> v1:172.21.15.173:6789/0 conn(0x7fccc80b42f0 legacy=0x7fccc80a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc5d9b640 10 monclient: _finish_hunting 0 2024-04-09T12:04:23.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc5d9b640 1 monclient: found mon.noname-a 2024-04-09T12:04:23.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:23.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc5d9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:04:23.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.489+0000 7fccc5d9b640 1 -- 172.21.15.173:0/2798720929 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc80a9070 con 0x7fccc8141660 2024-04-09T12:04:23.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.491+0000 7fccc5d9b640 1 --2- 172.21.15.173:0/2798720929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccc8141660 0x7fccc8141a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fccb80097a0 tx=0x7fccb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254ade7d177ef0af server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:23.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 1 -- 172.21.15.173:0/2798720929 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8031830 con 0x7fccc8141660 2024-04-09T12:04:23.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:04:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 10 monclient: dump: 2024-04-09T12:04:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 10 monclient: _finish_auth 0 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 10 monclient: _check_auth_tickets 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 1 -- 172.21.15.173:0/2798720929 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb8031990 con 0x7fccc8141660 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 1 -- 172.21.15.173:0/2798720929 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8031d20 con 0x7fccc8141660 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccccaa4640 5 monclient: authenticate success, global_id 4140 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccccaa4640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccccaa4640 4 set_mon_vals no callback set 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:04:23.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccc559a640 10 monclient: dump: 2024-04-09T12:04:23.500 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:23.500 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:23.500 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.500 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.500 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:23.500 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.500 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:23.500 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:23.500 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:23.500 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccccaa4640 10 monclient: shutdown 2024-04-09T12:04:23.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccccaa4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:23.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccccaa4640 1 -- 172.21.15.173:0/2798720929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccc8141660 msgr2=0x7fccc8141a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccccaa4640 1 --2- 172.21.15.173:0/2798720929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccc8141660 0x7fccc8141a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fccb80097a0 tx=0x7fccb802b8d0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccccaa4640 1 -- 172.21.15.173:0/2798720929 shutdown_connections 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccccaa4640 1 --2- 172.21.15.173:0/2798720929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fccc813e7f0 0x7fccc813ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccccaa4640 1 --2- 172.21.15.173:0/2798720929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccc8141660 0x7fccc8141a80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.495+0000 7fccccaa4640 1 -- 172.21.15.173:0/2798720929 >> 172.21.15.173:0/2798720929 conn(0x7fccc8065f30 msgr2=0x7fccc8066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.496+0000 7fccccaa4640 1 -- 172.21.15.173:0/2798720929 shutdown_connections 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.496+0000 7fccccaa4640 1 -- 172.21.15.173:0/2798720929 wait complete. 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.496+0000 7fccccaa4640 10 monclient: build_initial_monmap 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.496+0000 7fccccaa4640 10 monclient: monmap: 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 librados: starting msgr at 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 librados: starting objecter 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 Processor -- start 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 -- start start 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 librados: setting wanted keys 2024-04-09T12:04:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 librados: calling monclient init 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 10 monclient: init 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccc80b42f0 0x7fccc81376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 10 monclient(hunting): picked mon.noname-a con 0x7fccc80b42f0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fccc813e7f0 0x7fccc8133420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 10 monclient(hunting): picked mon.noname-c con 0x7fccc813e7f0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccc8141660 0x7fccc81d68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 10 monclient(hunting): picked mon.noname-b con 0x7fccc8141660 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc81d63c0 con 0x7fccc80b42f0 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc8144350 con 0x7fccc8141660 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc8145790 con 0x7fccc813e7f0 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.497+0000 7fccccaa4640 10 monclient(hunting): authenticate will time out at 1342.785900s 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccc80b42f0 0x7fccc81376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc6d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccc8141660 0x7fccc81d68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc5d9b640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fccc813e7f0 0x7fccc8133420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccc80b42f0 0x7fccc81376b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.173:56916/0 (socket says 172.21.15.173:56916) 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc659c640 1 -- 172.21.15.173:0/2579863500 learned_addr learned my addr 172.21.15.173:0/2579863500 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc659c640 10 monclient(hunting): get_auth_request con 0x7fccc80b42f0 auth_method 0 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc659c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc659c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc6d9d640 10 monclient(hunting): get_auth_request con 0x7fccc8141660 auth_method 0 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc6d9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc5d9b640 10 monclient(hunting): get_auth_request con 0x7fccc813e7f0 auth_method 0 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.498+0000 7fccc5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.499+0000 7fccc659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.499+0000 7fccc659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.499+0000 7fccc659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.499+0000 7fccc6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.499+0000 7fccc6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.499+0000 7fccc6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:23.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.499+0000 7fccc5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.499+0000 7fccc5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.499+0000 7fccc5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.501+0000 7fccc659c640 10 monclient(hunting): handle_auth_done global_id 4143 payload 824 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.501+0000 7fccc659c640 1 -- 172.21.15.173:0/2579863500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fccc813e7f0 msgr2=0x7fccc8133420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.501+0000 7fccc659c640 1 --2- 172.21.15.173:0/2579863500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fccc813e7f0 0x7fccc8133420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.501+0000 7fccc659c640 1 -- 172.21.15.173:0/2579863500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccc8141660 msgr2=0x7fccc81d68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.501+0000 7fccc659c640 1 --2- 172.21.15.173:0/2579863500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccc8141660 0x7fccc81d68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.501+0000 7fccc659c640 10 monclient: _finish_hunting 0 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.501+0000 7fccc659c640 1 monclient: found mon.noname-a 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.501+0000 7fccc659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.501+0000 7fccc659c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:04:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.501+0000 7fccc659c640 1 -- 172.21.15.173:0/2579863500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8009400 con 0x7fccc80b42f0 2024-04-09T12:04:23.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.504+0000 7fccc659c640 1 --2- 172.21.15.173:0/2579863500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccc80b42f0 0x7fccc81376b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00c500 tx=0x7fccbc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:23.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.504+0000 7fccb6ffd640 10 client.?.objecter ms_handle_connect 0x7fccc80b42f0 2024-04-09T12:04:23.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.504+0000 7fccb6ffd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:23.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 1 -- 172.21.15.173:0/2579863500 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc005ce0 con 0x7fccc80b42f0 2024-04-09T12:04:23.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:23.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:04:23.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 10 monclient: dump: 2024-04-09T12:04:23.512 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:23.512 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:23.512 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 10 monclient: _finish_auth 0 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 10 monclient: _check_auth_tickets 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 1 -- 172.21.15.173:0/2579863500 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc005e40 con 0x7fccc80b42f0 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 1 -- 172.21.15.173:0/2579863500 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc007330 con 0x7fccc80b42f0 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccb6ffd640 10 monclient: dump: 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:23.514 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccccaa4640 5 monclient: authenticate success, global_id 4143 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccc4d99640 4 set_mon_vals no callback set 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccccaa4640 10 monclient: _renew_subs 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccccaa4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccccaa4640 1 -- 172.21.15.173:0/2579863500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc8144f20 con 0x7fccc80b42f0 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccccaa4640 10 client.4143.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccccaa4640 10 monclient: _renew_subs 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccccaa4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccccaa4640 1 -- 172.21.15.173:0/2579863500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc8137bf0 con 0x7fccc80b42f0 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.507+0000 7fccccaa4640 1 librados: init done 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.508+0000 7fccccaa4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.508+0000 7fccccaa4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.508+0000 7fccccaa4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:23.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.508+0000 7fccccaa4640 1 -- 172.21.15.173:0/2579863500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc8137e40 con 0x7fccc80b42f0 2024-04-09T12:04:23.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.510+0000 7fccb6ffd640 1 -- 172.21.15.173:0/2579863500 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fccbc01c440 con 0x7fccc80b42f0 2024-04-09T12:04:23.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.510+0000 7fccb6ffd640 1 -- 172.21.15.173:0/2579863500 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fccbc01ba10 con 0x7fccc80b42f0 2024-04-09T12:04:23.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.510+0000 7fccb6ffd640 10 client.4143.objecter ms_dispatch 0x7fccc8000b90 osd_map(9..9 src has 1..9) v4 2024-04-09T12:04:23.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.510+0000 7fccb6ffd640 3 client.4143.objecter handle_osd_map got epochs [9,9] > 0 2024-04-09T12:04:23.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.510+0000 7fccb6ffd640 3 client.4143.objecter handle_osd_map decoding full epoch 9 2024-04-09T12:04:23.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.510+0000 7fccb6ffd640 20 client.4143.objecter dump_active .. 0 homeless 2024-04-09T12:04:23.534 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:23.532+0000 7f1d2f23b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-09T12:04:23.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.616+0000 7fccb6ffd640 1 -- 172.21.15.173:0/2579863500 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72706 (secure 0 0 0) 0x7fccc8137e40 con 0x7fccc80b42f0 2024-04-09T12:04:23.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.616+0000 7fccb6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:23.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.616+0000 7fccb6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:23.625 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:23.622+0000 7f6d5fa0f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-09T12:04:23.650 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:23.647+0000 7f1d2f23b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-09T12:04:23.678 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:23.675+0000 7f6d5fa0f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-09T12:04:23.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.688+0000 7fccccaa4640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "126085be-23ad-45b6-951d-47886bdfa75c", "id": 7}] 2024-04-09T12:04:23.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.688+0000 7fccccaa4640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "126085be-23ad-45b6-951d-47886bdfa75c", "id": 7}] 2024-04-09T12:04:23.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.688+0000 7fccccaa4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:23.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.688+0000 7fccccaa4640 1 -- 172.21.15.173:0/2579863500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "126085be-23ad-45b6-951d-47886bdfa75c", "id": 7} v 0) v1 -- 0x7fccc804e160 con 0x7fccc80b42f0 2024-04-09T12:04:23.798 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-09T12:04:23.795+0000 7f6d5fa0f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-09T12:04:23.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.847+0000 7fccb6ffd640 1 -- 172.21.15.173:0/2579863500 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "126085be-23ad-45b6-951d-47886bdfa75c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fccbc017070 con 0x7fccc80b42f0 2024-04-09T12:04:23.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.847+0000 7fccb6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "126085be-23ad-45b6-951d-47886bdfa75c", "id": 7}] 2024-04-09T12:04:23.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.847+0000 7fccb6ffd640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:23.850 INFO:teuthology.orchestra.run.smithi173.stdout:7 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 10 librados: watch_flush enter 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 10 librados: watch_flush exit 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 20 client.4143.objecter shutdown clearing up homeless session... 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 10 client.4143.objecter successfully canceled tick 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 10 monclient: shutdown 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 1 -- 172.21.15.173:0/2579863500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccc80b42f0 msgr2=0x7fccc81376b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 1 --2- 172.21.15.173:0/2579863500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccc80b42f0 0x7fccc81376b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00c500 tx=0x7fccbc00c9c0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 1 -- 172.21.15.173:0/2579863500 shutdown_connections 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 1 --2- 172.21.15.173:0/2579863500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccc8141660 0x7fccc81d68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 1 --2- 172.21.15.173:0/2579863500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fccc813e7f0 0x7fccc8133420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 1 --2- 172.21.15.173:0/2579863500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccc80b42f0 0x7fccc81376b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 1 -- 172.21.15.173:0/2579863500 >> 172.21.15.173:0/2579863500 conn(0x7fccc8065f30 msgr2=0x7fccc813cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:23.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 1 -- 172.21.15.173:0/2579863500 shutdown_connections 2024-04-09T12:04:23.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 1 -- 172.21.15.173:0/2579863500 wait complete. 2024-04-09T12:04:23.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-09T12:04:23.848+0000 7fccccaa4640 1 librados: shutdown 2024-04-09T12:04:23.862 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-09T12:04:23.862 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-09T12:04:23.863 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2024-04-09T12:04:23.865 INFO:tasks.ceph.osd.0:Started 2024-04-09T12:04:23.865 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-09T12:04:23.865 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-09T12:04:23.865 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2024-04-09T12:04:23.867 INFO:tasks.ceph.osd.1:Started 2024-04-09T12:04:23.867 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-09T12:04:23.867 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-09T12:04:23.868 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2024-04-09T12:04:23.870 INFO:tasks.ceph.osd.2:Started 2024-04-09T12:04:23.870 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-09T12:04:23.870 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-09T12:04:23.870 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2024-04-09T12:04:23.872 INFO:tasks.ceph.osd.3:Started 2024-04-09T12:04:23.872 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-09T12:04:23.872 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-09T12:04:23.873 DEBUG:teuthology.orchestra.run.smithi173:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2024-04-09T12:04:23.875 INFO:tasks.ceph.osd.4:Started 2024-04-09T12:04:23.875 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-09T12:04:23.875 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-09T12:04:23.875 DEBUG:teuthology.orchestra.run.smithi173:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2024-04-09T12:04:23.878 INFO:tasks.ceph.osd.5:Started 2024-04-09T12:04:23.878 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-09T12:04:23.878 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-09T12:04:23.878 DEBUG:teuthology.orchestra.run.smithi173:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2024-04-09T12:04:23.880 INFO:tasks.ceph.osd.6:Started 2024-04-09T12:04:23.880 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-09T12:04:23.880 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-09T12:04:23.880 DEBUG:teuthology.orchestra.run.smithi173:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2024-04-09T12:04:23.883 INFO:tasks.ceph.osd.7:Started 2024-04-09T12:04:23.883 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-09T12:04:24.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.037+0000 7f85741d5640 10 monclient: get_monmap_and_config 2024-04-09T12:04:24.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.037+0000 7f85741d5640 10 monclient: build_initial_monmap 2024-04-09T12:04:24.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.037+0000 7f85741d5640 10 monclient: monmap: 2024-04-09T12:04:24.041 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:04:24.039421+0000 2024-04-09T12:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:04:24.039421+0000 2024-04-09T12:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:24.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.038+0000 7f85741d5640 1 Processor -- start 2024-04-09T12:04:24.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.039+0000 7f85741d5640 1 -- start start 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.039+0000 7f85741d5640 10 monclient: init 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.039+0000 7f85741d5640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.039+0000 7f85741d5640 10 monclient: _add_conns ranks=[1,2,4,0,3] 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.039+0000 7f85741d5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f856c0b4420 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.039+0000 7f85741d5640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0a9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.040+0000 7f85741d5640 10 monclient(hunting): picked mon.noname-b con 0x7f856c0a8830 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.040+0000 7f85741d5640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f856c13e650 0x7f856c13eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.040+0000 7f85741d5640 10 monclient(hunting): picked mon.noname-c con 0x7f856c13e650 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.040+0000 7f85741d5640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c13f020 con 0x7f856c0b4420 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.040+0000 7f85741d5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.040+0000 7f85741d5640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c0b4800 con 0x7f856c13e650 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.040+0000 7f85741d5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.040+0000 7f85741d5640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0aa430 con 0x7f856c0a8830 2024-04-09T12:04:24.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.040+0000 7f85741d5640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:24.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.040+0000 7f85741d5640 10 monclient(hunting): authenticate will time out at 1330.160065s 2024-04-09T12:04:24.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.058+0000 7f8571770640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:24.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.058+0000 7f8571770640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0a9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:48766/0 (socket says 172.21.15.29:48766) 2024-04-09T12:04:24.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.058+0000 7f8571770640 1 -- 172.21.15.29:0/1346732620 learned_addr learned my addr 172.21.15.29:0/1346732620 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:04:24.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.058+0000 7f8571770640 10 monclient(hunting): get_auth_request con 0x7f856c0a8830 auth_method 0 2024-04-09T12:04:24.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.058+0000 7f8571770640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:24.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.058+0000 7f8571770640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:24.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.059+0000 7f8571770640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:24.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.071+0000 7f8571770640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:24.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.071+0000 7f8571770640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:24.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.071+0000 7f8571770640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:24.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.094+0000 7f8572772640 1 --2- 172.21.15.29:0/1346732620 >> v2:172.21.15.173:3300/0 conn(0x7f856c13e650 0x7f856c13eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:24.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.097+0000 7f8572772640 10 monclient(hunting): get_auth_request con 0x7f856c13e650 auth_method 0 2024-04-09T12:04:24.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.097+0000 7f8572772640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:24.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.097+0000 7f8572772640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:24.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.097+0000 7f8572772640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:24.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.100+0000 7f8572772640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:24.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.100+0000 7f8572772640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:24.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.100+0000 7f8572772640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:24.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.131+0000 7f8571770640 10 monclient(hunting): handle_auth_done global_id 4148 payload 274 2024-04-09T12:04:24.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.131+0000 7f8571770640 1 -- 172.21.15.29:0/1346732620 >> v2:172.21.15.173:3300/0 conn(0x7f856c13e650 msgr2=0x7f856c13eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:24.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.131+0000 7f8571770640 1 --2- 172.21.15.29:0/1346732620 >> v2:172.21.15.173:3300/0 conn(0x7f856c13e650 0x7f856c13eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:24.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.131+0000 7f8571770640 1 -- 172.21.15.29:0/1346732620 >> v1:172.21.15.173:6789/0 conn(0x7f856c0b4420 legacy=0x7f856c144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:24.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.131+0000 7f8571770640 10 monclient: _finish_hunting 0 2024-04-09T12:04:24.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.131+0000 7f8571770640 1 monclient: found mon.noname-b 2024-04-09T12:04:24.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.131+0000 7f8571770640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:24.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.131+0000 7f8571770640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:04:24.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.131+0000 7f8571770640 1 -- 172.21.15.29:0/1346732620 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0aa710 con 0x7f856c0a8830 2024-04-09T12:04:24.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.182+0000 7f8571770640 1 --2- 172.21.15.29:0/1346732620 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0a9270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f855c009870 tx=0x7f855c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62afe8ab0aea6fe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:24.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.198+0000 7f8570f6f640 1 -- 172.21.15.29:0/1346732620 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c0317c0 con 0x7f856c0a8830 2024-04-09T12:04:24.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.198+0000 7f8570f6f640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:24.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.198+0000 7f8570f6f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:04:24.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.198+0000 7f8570f6f640 10 monclient: dump: 2024-04-09T12:04:24.202 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:04:24.202 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:24.202 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:24.202 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:24.202 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:24.202 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:24.203 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:24.203 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:24.203 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:24.203 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:24.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.198+0000 7f8570f6f640 10 monclient: _finish_auth 0 2024-04-09T12:04:24.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.198+0000 7f8570f6f640 10 monclient: _check_auth_tickets 2024-04-09T12:04:24.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.198+0000 7f8570f6f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:24.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.199+0000 7f85741d5640 5 monclient: authenticate success, global_id 4148 2024-04-09T12:04:24.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.199+0000 7f85741d5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:24.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.206+0000 7f8570f6f640 1 -- 172.21.15.29:0/1346732620 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c031920 con 0x7f856c0a8830 2024-04-09T12:04:24.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.206+0000 7f8570f6f640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.206+0000 7f8570f6f640 1 -- 172.21.15.29:0/1346732620 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c0317c0 con 0x7f856c0a8830 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.206+0000 7f8570f6f640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.206+0000 7f8570f6f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.206+0000 7f8570f6f640 10 monclient: dump: 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:24.210 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.206+0000 7f85741d5640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.206+0000 7f85741d5640 4 set_mon_vals no callback set 2024-04-09T12:04:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.207+0000 7f85741d5640 10 monclient: shutdown 2024-04-09T12:04:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.207+0000 7f85741d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.207+0000 7f85741d5640 1 -- 172.21.15.29:0/1346732620 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 msgr2=0x7f856c0a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.207+0000 7f85741d5640 1 --2- 172.21.15.29:0/1346732620 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0a9270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f855c009870 tx=0x7f855c02b860 comp rx=0 tx=0).stop 2024-04-09T12:04:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.207+0000 7f85741d5640 1 -- 172.21.15.29:0/1346732620 shutdown_connections 2024-04-09T12:04:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.207+0000 7f85741d5640 1 --2- 172.21.15.29:0/1346732620 >> v2:172.21.15.173:3300/0 conn(0x7f856c13e650 0x7f856c13eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.207+0000 7f85741d5640 1 --2- 172.21.15.29:0/1346732620 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0a9270 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.207+0000 7f85741d5640 1 -- 172.21.15.29:0/1346732620 >> 172.21.15.29:0/1346732620 conn(0x7f856c065f00 msgr2=0x7f856c066310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.208+0000 7f85741d5640 1 -- 172.21.15.29:0/1346732620 shutdown_connections 2024-04-09T12:04:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.208+0000 7f85741d5640 1 -- 172.21.15.29:0/1346732620 wait complete. 2024-04-09T12:04:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.208+0000 7f85741d5640 10 monclient: build_initial_monmap 2024-04-09T12:04:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.208+0000 7f85741d5640 10 monclient: monmap: 2024-04-09T12:04:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:04:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:04:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:04:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:24.213 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.209+0000 7f85741d5640 1 librados: starting msgr at 2024-04-09T12:04:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.209+0000 7f85741d5640 1 librados: starting objecter 2024-04-09T12:04:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.209+0000 7f85741d5640 1 Processor -- start 2024-04-09T12:04:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.209+0000 7f85741d5640 1 -- start start 2024-04-09T12:04:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.209+0000 7f85741d5640 1 librados: setting wanted keys 2024-04-09T12:04:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.209+0000 7f85741d5640 1 librados: calling monclient init 2024-04-09T12:04:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.209+0000 7f85741d5640 10 monclient: init 2024-04-09T12:04:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 10 monclient(hunting): picked mon.noname-c con 0x7f856c0a8830 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f856c0b4420 0x7f856c1421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 10 monclient(hunting): picked mon.noname-b con 0x7f856c0b4420 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f856c13e650 0x7f856c0b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 10 monclient(hunting): picked mon.noname-a con 0x7f856c13e650 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c141a60 con 0x7f856c13e650 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c141d20 con 0x7f856c0b4420 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c1426f0 con 0x7f856c0a8830 2024-04-09T12:04:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:24.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.210+0000 7f85741d5640 10 monclient(hunting): authenticate will time out at 1330.330826s 2024-04-09T12:04:24.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.215+0000 7f8571f71640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.215+0000 7f8571f71640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:48776/0 (socket says 172.21.15.29:48776) 2024-04-09T12:04:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.215+0000 7f8571f71640 1 -- 172.21.15.29:0/1004237747 learned_addr learned my addr 172.21.15.29:0/1004237747 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:04:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.215+0000 7f8571f71640 10 monclient(hunting): get_auth_request con 0x7f856c0a8830 auth_method 0 2024-04-09T12:04:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.215+0000 7f8571f71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.215+0000 7f8571f71640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.215+0000 7f8571f71640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:24.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.216+0000 7f8571f71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:24.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.216+0000 7f8571f71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:24.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.216+0000 7f8571f71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.220+0000 7f8571f71640 10 monclient(hunting): handle_auth_done global_id 4151 payload 824 2024-04-09T12:04:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.220+0000 7f8571f71640 1 -- 172.21.15.29:0/1004237747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f856c0b4420 msgr2=0x7f856c1421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.220+0000 7f8571f71640 1 --2- 172.21.15.29:0/1004237747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f856c0b4420 0x7f856c1421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.220+0000 7f8571f71640 1 -- 172.21.15.29:0/1004237747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f856c13e650 msgr2=0x7f856c0b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.220+0000 7f8571f71640 1 --2- 172.21.15.29:0/1004237747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f856c13e650 0x7f856c0b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.220+0000 7f8571f71640 10 monclient: _finish_hunting 0 2024-04-09T12:04:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.220+0000 7f8571f71640 1 monclient: found mon.noname-c 2024-04-09T12:04:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.220+0000 7f8571f71640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.220+0000 7f8571f71640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:04:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.220+0000 7f8571f71640 1 -- 172.21.15.29:0/1004237747 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c0094d0 con 0x7f856c0a8830 2024-04-09T12:04:24.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.224+0000 7f8571f71640 1 --2- 172.21.15.29:0/1004237747 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0b78c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f856800c410 tx=0x7f856800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:24.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.224+0000 7f85627fc640 10 client.?.objecter ms_handle_connect 0x7f856c0a8830 2024-04-09T12:04:24.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.224+0000 7f85627fc640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.230+0000 7f85627fc640 1 -- 172.21.15.29:0/1004237747 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680035f0 con 0x7f856c0a8830 2024-04-09T12:04:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.230+0000 7f85627fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.230+0000 7f85627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:04:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.230+0000 7f85627fc640 10 monclient: dump: 2024-04-09T12:04:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:04:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.230+0000 7f85627fc640 10 monclient: _finish_auth 0 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.230+0000 7f85627fc640 10 monclient: _check_auth_tickets 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.230+0000 7f85627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85627fc640 1 -- 172.21.15.29:0/1004237747 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8568003750 con 0x7f856c0a8830 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85627fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85627fc640 1 -- 172.21.15.29:0/1004237747 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568003b40 con 0x7f856c0a8830 2024-04-09T12:04:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85627fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85627fc640 10 monclient: dump: 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:04:24.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f8563fff640 4 set_mon_vals no callback set 2024-04-09T12:04:24.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85741d5640 5 monclient: authenticate success, global_id 4151 2024-04-09T12:04:24.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85741d5640 10 monclient: _renew_subs 2024-04-09T12:04:24.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85741d5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:24.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85741d5640 1 -- 172.21.15.29:0/1004237747 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c0b18d0 con 0x7f856c0a8830 2024-04-09T12:04:24.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85741d5640 10 client.4151.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:24.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85741d5640 10 monclient: _renew_subs 2024-04-09T12:04:24.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85741d5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:24.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85741d5640 1 -- 172.21.15.29:0/1004237747 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c13f680 con 0x7f856c0a8830 2024-04-09T12:04:24.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.231+0000 7f85741d5640 1 librados: init done 2024-04-09T12:04:24.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.233+0000 7f85741d5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:24.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.233+0000 7f85741d5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:24.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.233+0000 7f85741d5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:24.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.233+0000 7f85741d5640 1 -- 172.21.15.29:0/1004237747 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c04e160 con 0x7f856c0a8830 2024-04-09T12:04:24.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.368+0000 7f85627fc640 1 -- 172.21.15.29:0/1004237747 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 2) v1 ==== 44528+0+0 (secure 0 0 0) 0x7f8568003ca0 con 0x7f856c0a8830 2024-04-09T12:04:24.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.371+0000 7f85627fc640 1 -- 172.21.15.29:0/1004237747 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f85680010c0 con 0x7f856c0a8830 2024-04-09T12:04:24.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.371+0000 7f85627fc640 10 client.4151.objecter ms_dispatch 0x7f856c000b90 osd_map(10..10 src has 1..10) v4 2024-04-09T12:04:24.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.371+0000 7f85627fc640 3 client.4151.objecter handle_osd_map got epochs [10,10] > 0 2024-04-09T12:04:24.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.371+0000 7f85627fc640 3 client.4151.objecter handle_osd_map decoding full epoch 10 2024-04-09T12:04:24.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.371+0000 7f85627fc640 20 client.4151.objecter dump_active .. 0 homeless 2024-04-09T12:04:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.556+0000 7f85627fc640 1 -- 172.21.15.29:0/1004237747 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72706 (secure 0 0 0) 0x7f856800ece0 con 0x7f856c0a8830 2024-04-09T12:04:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.556+0000 7f85627fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.556+0000 7f85627fc640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:24.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.679+0000 7f85741d5640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:24.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.679+0000 7f85741d5640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:24.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.679+0000 7f85741d5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:24.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.679+0000 7f85741d5640 1 -- 172.21.15.29:0/1004237747 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f856c140450 con 0x7f856c0a8830 2024-04-09T12:04:24.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.792+0000 7f85627fc640 1 -- 172.21.15.29:0/1004237747 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8568010e60 con 0x7f856c0a8830 2024-04-09T12:04:24.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.792+0000 7f85627fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:24.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.792+0000 7f85627fc640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:24.795 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:04:24.796 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"fsid":"1673ebad-34a7-414e-b498-c4f5250b317b","created":"2024-04-09T12:04:18.271948+0000","modified":"2024-04-09T12:04:23.695144+0000","last_up_change":"0.000000","last_in_change":"2024-04-09T12:04:23.695144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c929787-7de5-4d2f-9b36-3a165fa73386","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54d0b5c7-3415-4585-8a9b-c67a8ae94ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a343481-8465-4e19-989c-4a62c926338c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7f553202-73e9-496c-893f-185c61f66807","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84050623-d3f3-40ba-b63e-92d56a74bfd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"883e841f-8acc-4268-8e64-c556b10befa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"126085be-23ad-45b6-951d-47886bdfa75c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-09T12:04:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 10 librados: watch_flush enter 2024-04-09T12:04:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 10 librados: watch_flush exit 2024-04-09T12:04:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 20 client.4151.objecter shutdown clearing up homeless session... 2024-04-09T12:04:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 10 client.4151.objecter successfully canceled tick 2024-04-09T12:04:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 10 monclient: shutdown 2024-04-09T12:04:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 1 -- 172.21.15.29:0/1004237747 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 msgr2=0x7f856c0b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 1 --2- 172.21.15.29:0/1004237747 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0b78c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f856800c410 tx=0x7f856800c8d0 comp rx=0 tx=0).stop 2024-04-09T12:04:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 1 -- 172.21.15.29:0/1004237747 shutdown_connections 2024-04-09T12:04:24.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 1 --2- 172.21.15.29:0/1004237747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f856c13e650 0x7f856c0b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:24.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 1 --2- 172.21.15.29:0/1004237747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f856c0b4420 0x7f856c1421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:24.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 1 --2- 172.21.15.29:0/1004237747 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f856c0a8830 0x7f856c0b78c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:24.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 1 -- 172.21.15.29:0/1004237747 >> 172.21.15.29:0/1004237747 conn(0x7f856c065f00 msgr2=0x7f856c0b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:24.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 1 -- 172.21.15.29:0/1004237747 shutdown_connections 2024-04-09T12:04:24.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 1 -- 172.21.15.29:0/1004237747 wait complete. 2024-04-09T12:04:24.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:04:24.793+0000 7f85741d5640 1 librados: shutdown 2024-04-09T12:04:24.812 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-09T12:04:24.813 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-09T12:04:25.619 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-09T12:04:25.763 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.760+0000 7fba808dc640 10 monclient: get_monmap_and_config 2024-04-09T12:04:25.763 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.760+0000 7fba808dc640 10 monclient: build_initial_monmap 2024-04-09T12:04:25.763 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.760+0000 7fba808dc640 10 monclient: monmap: 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:04:25.761733+0000 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:04:25.761733+0000 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:25.764 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:25.766 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.761+0000 7fba808dc640 1 Processor -- start 2024-04-09T12:04:25.766 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.761+0000 7fba808dc640 1 -- start start 2024-04-09T12:04:25.766 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.761+0000 7fba808dc640 10 monclient: init 2024-04-09T12:04:25.766 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:25.766 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 10 monclient: _add_conns ranks=[0,4,3,2,1] 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fba7c0b7c80 addr v1:172.21.15.29:6789/0 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fba7c0b1040 0x7fba7c0a9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 10 monclient(hunting): picked mon.noname-c con 0x7fba7c0b1040 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fba7c13eb00 0x7fba7c13ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 10 monclient(hunting): picked mon.noname-a con 0x7fba7c13eb00 addr v2:172.21.15.29:3300/0 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c0aa3d0 con 0x7fba7c0b7c80 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c0a8f10 con 0x7fba7c13eb00 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c0b8060 con 0x7fba7c0b1040 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.762+0000 7fba808dc640 10 monclient(hunting): authenticate will time out at 1331.882601s 2024-04-09T12:04:25.767 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.763+0000 7fba7a59c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fba7c0b7c80 0x7fba7c1418c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34376/0 (socket says 172.21.15.29:34376) 2024-04-09T12:04:25.768 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.763+0000 7fba7a59c640 1 -- 172.21.15.29:0/1828823647 learned_addr learned my addr 172.21.15.29:0/1828823647 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:04:25.768 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.764+0000 7fba7ad9d640 1 --2- 172.21.15.29:0/1828823647 >> v2:172.21.15.29:3300/0 conn(0x7fba7c13eb00 0x7fba7c13ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:25.771 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.768+0000 7fba7959a640 1 -- 172.21.15.29:0/1828823647 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625220574 0 0) 0x7fba7c0aa3d0 con 0x7fba7c0b7c80 2024-04-09T12:04:25.772 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.768+0000 7fba7959a640 10 monclient(hunting): _negotiate 2024-04-09T12:04:25.772 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.768+0000 7fba7959a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:25.772 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.768+0000 7fba7959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:25.772 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.768+0000 7fba7959a640 10 monclient(hunting): my global_id is 4146 2024-04-09T12:04:25.772 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.768+0000 7fba7959a640 1 -- 172.21.15.29:0/1828823647 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba64003520 con 0x7fba7c0b7c80 2024-04-09T12:04:25.772 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.768+0000 7fba7ad9d640 10 monclient(hunting): get_auth_request con 0x7fba7c13eb00 auth_method 0 2024-04-09T12:04:25.772 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.768+0000 7fba7ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:25.772 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.768+0000 7fba7ad9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:25.772 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.768+0000 7fba7ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:25.775 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.772+0000 7fba7ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:25.775 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.772+0000 7fba7ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:25.775 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.772+0000 7fba7ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:25.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.776+0000 7fba7ad9d640 10 monclient(hunting): handle_auth_done global_id 4149 payload 274 2024-04-09T12:04:25.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.776+0000 7fba7ad9d640 1 -- 172.21.15.29:0/1828823647 >> v2:172.21.15.173:3300/0 conn(0x7fba7c0b1040 msgr2=0x7fba7c0a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:25.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.776+0000 7fba7ad9d640 1 --2- 172.21.15.29:0/1828823647 >> v2:172.21.15.173:3300/0 conn(0x7fba7c0b1040 0x7fba7c0a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:25.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.776+0000 7fba7ad9d640 1 -- 172.21.15.29:0/1828823647 >> v1:172.21.15.29:6789/0 conn(0x7fba7c0b7c80 legacy=0x7fba7c1418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:25.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.776+0000 7fba7ad9d640 10 monclient: _finish_hunting 0 2024-04-09T12:04:25.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.776+0000 7fba7ad9d640 1 monclient: found mon.noname-a 2024-04-09T12:04:25.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.776+0000 7fba7ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:25.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.776+0000 7fba7ad9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:04:25.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.776+0000 7fba7ad9d640 1 -- 172.21.15.29:0/1828823647 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0aa920 con 0x7fba7c13eb00 2024-04-09T12:04:25.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.786+0000 7fba7ad9d640 1 --2- 172.21.15.29:0/1828823647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c13eb00 0x7fba7c13ef70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0a8810 tx=0x7fba7402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5539701c86fa5bc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:25.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.789+0000 7fba7959a640 1 -- 172.21.15.29:0/1828823647 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7402cc80 con 0x7fba7c13eb00 2024-04-09T12:04:25.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.789+0000 7fba7959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:25.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.789+0000 7fba7959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:04:25.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.789+0000 7fba7959a640 10 monclient: dump: 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.789+0000 7fba7959a640 10 monclient: _finish_auth 0 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.789+0000 7fba7959a640 10 monclient: _check_auth_tickets 2024-04-09T12:04:25.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.789+0000 7fba7959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:25.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.789+0000 7fba808dc640 5 monclient: authenticate success, global_id 4149 2024-04-09T12:04:25.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.789+0000 7fba808dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:25.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.791+0000 7fba7959a640 1 -- 172.21.15.29:0/1828823647 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7402cde0 con 0x7fba7c13eb00 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.791+0000 7fba7959a640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.791+0000 7fba7959a640 1 -- 172.21.15.29:0/1828823647 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74034640 con 0x7fba7c13eb00 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.791+0000 7fba7959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.791+0000 7fba7959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.791+0000 7fba7959a640 10 monclient: dump: 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:25.795 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:25.796 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:25.796 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:25.796 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:25.796 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.791+0000 7fba808dc640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:25.796 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.791+0000 7fba808dc640 4 set_mon_vals no callback set 2024-04-09T12:04:25.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.792+0000 7fba808dc640 10 monclient: shutdown 2024-04-09T12:04:25.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.792+0000 7fba808dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:25.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.792+0000 7fba808dc640 1 -- 172.21.15.29:0/1828823647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c13eb00 msgr2=0x7fba7c13ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:25.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.792+0000 7fba808dc640 1 --2- 172.21.15.29:0/1828823647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c13eb00 0x7fba7c13ef70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0a8810 tx=0x7fba7402bed0 comp rx=0 tx=0).stop 2024-04-09T12:04:25.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.793+0000 7fba808dc640 1 -- 172.21.15.29:0/1828823647 shutdown_connections 2024-04-09T12:04:25.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.793+0000 7fba808dc640 1 --2- 172.21.15.29:0/1828823647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c13eb00 0x7fba7c13ef70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:25.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.793+0000 7fba808dc640 1 --2- 172.21.15.29:0/1828823647 >> v2:172.21.15.173:3300/0 conn(0x7fba7c0b1040 0x7fba7c0a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:25.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.793+0000 7fba808dc640 1 -- 172.21.15.29:0/1828823647 >> 172.21.15.29:0/1828823647 conn(0x7fba7c071b70 msgr2=0x7fba7c0b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:25.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.793+0000 7fba808dc640 1 -- 172.21.15.29:0/1828823647 shutdown_connections 2024-04-09T12:04:25.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.793+0000 7fba808dc640 1 -- 172.21.15.29:0/1828823647 wait complete. 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.794+0000 7fba808dc640 10 monclient: build_initial_monmap 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.794+0000 7fba808dc640 10 monclient: monmap: 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr:last_changed 0.000000 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr:created 0.000000 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:25.799 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:25.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.795+0000 7fba808dc640 1 librados: starting msgr at 2024-04-09T12:04:25.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.795+0000 7fba808dc640 1 librados: starting objecter 2024-04-09T12:04:25.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.795+0000 7fba808dc640 1 Processor -- start 2024-04-09T12:04:25.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.795+0000 7fba808dc640 1 -- start start 2024-04-09T12:04:25.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.795+0000 7fba808dc640 1 librados: setting wanted keys 2024-04-09T12:04:25.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.795+0000 7fba808dc640 1 librados: calling monclient init 2024-04-09T12:04:25.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.795+0000 7fba808dc640 10 monclient: init 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.796+0000 7fba808dc640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.796+0000 7fba808dc640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.796+0000 7fba808dc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba7c0b1040 0x7fba7c1393f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.796+0000 7fba808dc640 10 monclient(hunting): picked mon.noname-b con 0x7fba7c0b1040 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.796+0000 7fba808dc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c0b7c80 0x7fba7c1d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.796+0000 7fba808dc640 10 monclient(hunting): picked mon.noname-a con 0x7fba7c0b7c80 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.796+0000 7fba808dc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba7c13eb00 0x7fba7c1d7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.796+0000 7fba808dc640 10 monclient(hunting): picked mon.noname-c con 0x7fba7c13eb00 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.797+0000 7fba808dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.797+0000 7fba808dc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c13a880 con 0x7fba7c0b7c80 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.797+0000 7fba808dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.797+0000 7fba808dc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c144430 con 0x7fba7c0b1040 2024-04-09T12:04:25.804 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.797+0000 7fba808dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.797+0000 7fba808dc640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c1d67f0 con 0x7fba7c13eb00 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.797+0000 7fba808dc640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.797+0000 7fba808dc640 10 monclient(hunting): authenticate will time out at 1331.917450s 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.797+0000 7fba7ad9d640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba7c13eb00 0x7fba7c1d7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.797+0000 7fba79d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c0b7c80 0x7fba7c1d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba7ad9d640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba7c13eb00 0x7fba7c1d7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:48782/0 (socket says 172.21.15.29:48782) 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba7ad9d640 1 -- 172.21.15.29:0/3640523556 learned_addr learned my addr 172.21.15.29:0/3640523556 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba7ad9d640 10 monclient(hunting): get_auth_request con 0x7fba7c13eb00 auth_method 0 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba7ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba7ad9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba7ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba79d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c0b7c80 0x7fba7c1d6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60508/0 (socket says 172.21.15.29:60508) 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba79d9b640 10 monclient(hunting): get_auth_request con 0x7fba7c0b7c80 auth_method 0 2024-04-09T12:04:25.805 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba79d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:25.806 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba79d9b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:25.806 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba79d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:25.806 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba79d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:25.806 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba79d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:25.806 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba79d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:25.806 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba7ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:25.806 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba7ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:25.806 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.798+0000 7fba7ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:25.806 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.802+0000 7fba79d9b640 10 monclient(hunting): handle_auth_done global_id 4152 payload 824 2024-04-09T12:04:25.806 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.802+0000 7fba79d9b640 1 -- 172.21.15.29:0/3640523556 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba7c13eb00 msgr2=0x7fba7c1d7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:25.807 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.802+0000 7fba79d9b640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba7c13eb00 0x7fba7c1d7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:25.807 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.803+0000 7fba79d9b640 1 -- 172.21.15.29:0/3640523556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba7c0b1040 msgr2=0x7fba7c1393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:25.807 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.803+0000 7fba79d9b640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba7c0b1040 0x7fba7c1393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:25.807 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.803+0000 7fba79d9b640 10 monclient: _finish_hunting 0 2024-04-09T12:04:25.807 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.803+0000 7fba79d9b640 1 monclient: found mon.noname-a 2024-04-09T12:04:25.807 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.803+0000 7fba79d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:25.807 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.803+0000 7fba79d9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:04:25.807 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.803+0000 7fba79d9b640 1 -- 172.21.15.29:0/3640523556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba74009a70 con 0x7fba7c0b7c80 2024-04-09T12:04:25.809 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.806+0000 7fba79d9b640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c0b7c80 0x7fba7c1d6d10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba7000b3f0 tx=0x7fba7000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:25.809 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.806+0000 7fba6affd640 10 client.?.objecter ms_handle_connect 0x7fba7c0b7c80 2024-04-09T12:04:25.809 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.806+0000 7fba6affd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:25.816 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 1 -- 172.21.15.29:0/3640523556 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70011830 con 0x7fba7c0b7c80 2024-04-09T12:04:25.816 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:25.816 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:04:25.816 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 10 monclient: dump: 2024-04-09T12:04:25.816 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:25.816 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:25.816 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:25.816 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:25.816 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:25.816 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:25.816 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 10 monclient: _finish_auth 0 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 10 monclient: _check_auth_tickets 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 1 -- 172.21.15.29:0/3640523556 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba70011990 con 0x7fba7c0b7c80 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 1 -- 172.21.15.29:0/3640523556 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70011d40 con 0x7fba7c0b7c80 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba6affd640 10 monclient: dump: 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:25.817 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.811+0000 7fba78d99640 4 set_mon_vals no callback set 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.812+0000 7fba808dc640 5 monclient: authenticate success, global_id 4152 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.812+0000 7fba808dc640 10 monclient: _renew_subs 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.812+0000 7fba808dc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:25.818 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.812+0000 7fba808dc640 1 -- 172.21.15.29:0/3640523556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c145a10 con 0x7fba7c0b7c80 2024-04-09T12:04:25.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.812+0000 7fba808dc640 10 client.4152.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:25.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.812+0000 7fba808dc640 10 monclient: _renew_subs 2024-04-09T12:04:25.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.812+0000 7fba808dc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:25.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.812+0000 7fba808dc640 1 -- 172.21.15.29:0/3640523556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c1451e0 con 0x7fba7c0b7c80 2024-04-09T12:04:25.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.812+0000 7fba808dc640 1 librados: init done 2024-04-09T12:04:25.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.813+0000 7fba808dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:25.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.813+0000 7fba808dc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:25.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.813+0000 7fba808dc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:25.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.813+0000 7fba808dc640 1 -- 172.21.15.29:0/3640523556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c04e160 con 0x7fba7c0b7c80 2024-04-09T12:04:25.908 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:25.906+0000 7f1ccff11640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-09T12:04:25.909 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-09T12:04:25.906+0000 7f1ccff11640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-09T12:04:25.918 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.915+0000 7fba6affd640 1 -- 172.21.15.29:0/3640523556 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 3) v1 ==== 88983+0+0 (secure 0 0 0) 0x7fba7001a400 con 0x7fba7c0b7c80 2024-04-09T12:04:25.918 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.915+0000 7fba6affd640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fba5c06c430 0x7fba5c06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:25.919 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.915+0000 7fba7a59c640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fba5c06c430 0x7fba5c06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:25.919 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.916+0000 7fba7a59c640 10 monclient: get_auth_request con 0x7fba5c06c430 auth_method 0 2024-04-09T12:04:25.919 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.916+0000 7fba6affd640 10 client.4152.objecter ms_handle_connect 0x7fba5c06c430 2024-04-09T12:04:25.919 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:25.916+0000 7fba7a59c640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fba5c06c430 0x7fba5c06e8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba6c001610 tx=0x7fba6c007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:26.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.270+0000 7fba6affd640 1 -- 172.21.15.29:0/3640523556 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fba70058f50 con 0x7fba7c0b7c80 2024-04-09T12:04:26.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.270+0000 7fba6affd640 10 client.4152.objecter ms_dispatch 0x7fba7c000b90 osd_map(10..10 src has 1..10) v4 2024-04-09T12:04:26.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.270+0000 7fba6affd640 3 client.4152.objecter handle_osd_map got epochs [10,10] > 0 2024-04-09T12:04:26.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.270+0000 7fba6affd640 3 client.4152.objecter handle_osd_map decoding full epoch 10 2024-04-09T12:04:26.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.270+0000 7fba6affd640 20 client.4152.objecter dump_active .. 0 homeless 2024-04-09T12:04:26.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.270+0000 7fba6affd640 1 -- 172.21.15.29:0/3640523556 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fba70054b90 con 0x7fba7c0b7c80 2024-04-09T12:04:26.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.270+0000 7fba6affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:26.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.270+0000 7fba6affd640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:26.649 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.645+0000 7fba808dc640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:26.649 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.645+0000 7fba808dc640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:26.649 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.645+0000 7fba808dc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:26.649 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.645+0000 7fba808dc640 1 -- 172.21.15.29:0/3640523556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba7c145ba0 con 0x7fba7c0b7c80 2024-04-09T12:04:26.862 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.859+0000 7fba6affd640 1 -- 172.21.15.29:0/3640523556 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fba70015020 con 0x7fba7c0b7c80 2024-04-09T12:04:26.863 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.859+0000 7fba6affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:26.863 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.859+0000 7fba6affd640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:26.863 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-09T12:04:26.863 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"1673ebad-34a7-414e-b498-c4f5250b317b","created":"2024-04-09T12:04:18.271948+0000","modified":"2024-04-09T12:04:23.695144+0000","last_up_change":"0.000000","last_in_change":"2024-04-09T12:04:23.695144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c929787-7de5-4d2f-9b36-3a165fa73386","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54d0b5c7-3415-4585-8a9b-c67a8ae94ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a343481-8465-4e19-989c-4a62c926338c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7f553202-73e9-496c-893f-185c61f66807","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84050623-d3f3-40ba-b63e-92d56a74bfd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"883e841f-8acc-4268-8e64-c556b10befa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"126085be-23ad-45b6-951d-47886bdfa75c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-09T12:04:26.865 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 10 librados: watch_flush enter 2024-04-09T12:04:26.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 10 librados: watch_flush exit 2024-04-09T12:04:26.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 20 client.4152.objecter shutdown clearing up homeless session... 2024-04-09T12:04:26.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 10 client.4152.objecter successfully canceled tick 2024-04-09T12:04:26.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 -- 172.21.15.29:0/3640523556 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fba5c06c430 msgr2=0x7fba5c06e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:26.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fba5c06c430 0x7fba5c06e8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba6c001610 tx=0x7fba6c007930 comp rx=0 tx=0).stop 2024-04-09T12:04:26.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 10 monclient: shutdown 2024-04-09T12:04:26.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:26.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 -- 172.21.15.29:0/3640523556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c0b7c80 msgr2=0x7fba7c1d6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:26.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c0b7c80 0x7fba7c1d6d10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba7000b3f0 tx=0x7fba7000b8b0 comp rx=0 tx=0).stop 2024-04-09T12:04:26.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 -- 172.21.15.29:0/3640523556 shutdown_connections 2024-04-09T12:04:26.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fba5c06c430 0x7fba5c06e8f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:26.867 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba7c13eb00 0x7fba7c1d7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:26.867 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c0b7c80 0x7fba7c1d6d10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:26.867 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 --2- 172.21.15.29:0/3640523556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba7c0b1040 0x7fba7c1393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:26.867 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 -- 172.21.15.29:0/3640523556 >> 172.21.15.29:0/3640523556 conn(0x7fba7c071b70 msgr2=0x7fba7c0b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:26.867 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 -- 172.21.15.29:0/3640523556 shutdown_connections 2024-04-09T12:04:26.867 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 -- 172.21.15.29:0/3640523556 wait complete. 2024-04-09T12:04:26.867 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:26.862+0000 7fba808dc640 1 librados: shutdown 2024-04-09T12:04:26.879 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-09T12:04:31.220 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:07.278 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.267 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:07.320 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.280 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:07.338 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.326 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:07.380 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.413 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:07.473 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.426 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:07.484 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.472 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:07.532 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.485 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:07.542 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.675 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:07.732 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.717 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:07.767 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.737 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:07.793 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.783 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:07.832 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.799 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:07.843 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.831 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:07.893 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.862 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:04:31.853+0000 5dc2480 -1 Falling back to public interface 2024-04-09T12:04:31.868 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:07.912 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:31.890 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:04:31.881+0000 5dc2480 -1 Falling back to public interface 2024-04-09T12:04:31.894 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:07.956 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.042 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:04:32.033+0000 5dc2480 -1 Falling back to public interface 2024-04-09T12:04:32.059 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:04:32.051+0000 5dc2480 -1 Falling back to public interface 2024-04-09T12:04:32.300 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:04:32.291+0000 5dc2480 -1 Falling back to public interface 2024-04-09T12:04:32.336 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:04:32.325+0000 5dc2480 -1 Falling back to public interface 2024-04-09T12:04:32.357 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:08.415 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.364 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:08.418 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.414 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:04:32.404+0000 5dc2480 -1 Falling back to public interface 2024-04-09T12:04:32.464 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:04:32.454+0000 5dc2480 -1 Falling back to public interface 2024-04-09T12:04:32.489 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:08.550 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.584 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:08.641 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.712 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:08.770 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.729 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:08.783 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.804 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:08.860 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.822 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:08.872 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.843 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:08.904 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.883 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:08.927 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.946 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:09.003 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:32.957 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:09.019 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.024 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:09.082 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.091 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:09.144 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.159 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:09.215 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.183 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:09.232 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.195 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:09.256 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.243 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:09.286 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.261 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:09.319 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.297 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:09.355 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.322 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:09.383 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.387 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:09.440 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.477 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:09.533 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.482 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:09.543 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.501 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:09.550 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.526 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:09.583 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.562 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:09.606 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.566 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:09.624 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.678 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:09.739 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.680 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:09.734 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.684 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-09T12:04:33.752 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:09.809 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.773 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.770+0000 7f73f0191640 10 monclient: get_monmap_and_config 2024-04-09T12:04:33.773 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.770+0000 7f73f0191640 10 monclient: build_initial_monmap 2024-04-09T12:04:33.774 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:09.823 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.777 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.770+0000 7f73f0191640 10 monclient: monmap: 2024-04-09T12:04:33.777 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:04:33.777 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:33.777 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:04:33.772078+0000 2024-04-09T12:04:33.777 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:04:33.772078+0000 2024-04-09T12:04:33.777 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:33.777 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:33.777 INFO:teuthology.misc.health.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:33.777 INFO:teuthology.misc.health.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:33.777 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:33.778 INFO:teuthology.misc.health.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:33.778 INFO:teuthology.misc.health.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:33.778 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:33.778 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 1 Processor -- start 2024-04-09T12:04:33.778 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 1 -- start start 2024-04-09T12:04:33.778 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 10 monclient: init 2024-04-09T12:04:33.778 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:33.778 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2024-04-09T12:04:33.778 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f73e80b7c80 0x7f73e80a9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:33.778 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 10 monclient(hunting): picked mon.noname-c con 0x7f73e80b7c80 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:33.778 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f73e80b1040 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e813ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 10 monclient(hunting): picked mon.noname-b con 0x7f73e813eb00 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80aa3d0 con 0x7f73e80b1040 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e80a8f10 con 0x7f73e80b7c80 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80b8060 con 0x7f73e813eb00 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.771+0000 7f73f0191640 10 monclient(hunting): authenticate will time out at 1339.891973s 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.772+0000 7f73ee72e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e813ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.772+0000 7f73ee72e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e813ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:58394/0 (socket says 172.21.15.29:58394) 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.772+0000 7f73ee72e640 1 -- 172.21.15.29:0/3387219561 learned_addr learned my addr 172.21.15.29:0/3387219561 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:04:33.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.772+0000 7f73ee72e640 10 monclient(hunting): get_auth_request con 0x7f73e813eb00 auth_method 0 2024-04-09T12:04:33.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.772+0000 7f73ee72e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:33.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.772+0000 7f73ee72e640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:33.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.772+0000 7f73ee72e640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:33.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.772+0000 7f73edf2d640 1 --2- 172.21.15.29:0/3387219561 >> v2:172.21.15.173:3300/0 conn(0x7f73e80b7c80 0x7f73e80a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:33.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.773+0000 7f73ee72e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:33.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.773+0000 7f73ee72e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:33.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.773+0000 7f73ee72e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:33.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.773+0000 7f73edf2d640 10 monclient(hunting): get_auth_request con 0x7f73e80b7c80 auth_method 0 2024-04-09T12:04:33.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.773+0000 7f73edf2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:33.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.773+0000 7f73edf2d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:33.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.773+0000 7f73edf2d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:33.781 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.774+0000 7f73edf2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:33.781 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.774+0000 7f73edf2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:33.781 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.774+0000 7f73edf2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:33.781 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:09.834 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.782 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.775+0000 7f73ee72e640 10 monclient(hunting): handle_auth_done global_id 4178 payload 274 2024-04-09T12:04:33.782 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.775+0000 7f73ee72e640 1 -- 172.21.15.29:0/3387219561 >> v2:172.21.15.173:3300/0 conn(0x7f73e80b7c80 msgr2=0x7f73e80a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:33.782 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.775+0000 7f73ee72e640 1 --2- 172.21.15.29:0/3387219561 >> v2:172.21.15.173:3300/0 conn(0x7f73e80b7c80 0x7f73e80a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:33.782 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.775+0000 7f73ee72e640 1 -- 172.21.15.29:0/3387219561 >> v1:172.21.15.173:6789/0 conn(0x7f73e80b1040 legacy=0x7f73e81418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:33.782 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.775+0000 7f73ee72e640 10 monclient: _finish_hunting 0 2024-04-09T12:04:33.783 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.775+0000 7f73ee72e640 1 monclient: found mon.noname-b 2024-04-09T12:04:33.783 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.775+0000 7f73ee72e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:33.783 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.775+0000 7f73ee72e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:04:33.783 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.775+0000 7f73ee72e640 1 -- 172.21.15.29:0/3387219561 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80aa920 con 0x7f73e813eb00 2024-04-09T12:04:33.783 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.776+0000 7f73ee72e640 1 --2- 172.21.15.29:0/3387219561 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e813ef90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009e50 tx=0x7f73e002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4ef5070a35a8efc server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:33.787 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 1 -- 172.21.15.29:0/3387219561 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e002cb00 con 0x7f73e813eb00 2024-04-09T12:04:33.787 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:33.787 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 10 monclient: dump: 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 10 monclient: _finish_auth 0 2024-04-09T12:04:33.788 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 10 monclient: _check_auth_tickets 2024-04-09T12:04:33.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:33.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 1 -- 172.21.15.29:0/3387219561 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e002cc60 con 0x7f73e813eb00 2024-04-09T12:04:33.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:33.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 1 -- 172.21.15.29:0/3387219561 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e00343f0 con 0x7f73e813eb00 2024-04-09T12:04:33.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:33.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:04:33.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73ecf2b640 10 monclient: dump: 2024-04-09T12:04:33.789 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:33.789 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:33.789 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:33.789 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73f0191640 5 monclient: authenticate success, global_id 4178 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73f0191640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.780+0000 7f73f0191640 4 set_mon_vals no callback set 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.781+0000 7f73f0191640 10 monclient: shutdown 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.781+0000 7f73f0191640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:33.790 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.781+0000 7f73f0191640 1 -- 172.21.15.29:0/3387219561 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 msgr2=0x7f73e813ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.781+0000 7f73f0191640 1 --2- 172.21.15.29:0/3387219561 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e813ef90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009e50 tx=0x7f73e002bf60 comp rx=0 tx=0).stop 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.781+0000 7f73f0191640 1 -- 172.21.15.29:0/3387219561 shutdown_connections 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.781+0000 7f73f0191640 1 --2- 172.21.15.29:0/3387219561 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e813ef90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.781+0000 7f73f0191640 1 --2- 172.21.15.29:0/3387219561 >> v2:172.21.15.173:3300/0 conn(0x7f73e80b7c80 0x7f73e80a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.781+0000 7f73f0191640 1 -- 172.21.15.29:0/3387219561 >> 172.21.15.29:0/3387219561 conn(0x7f73e8071b70 msgr2=0x7f73e80b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.781+0000 7f73f0191640 1 -- 172.21.15.29:0/3387219561 shutdown_connections 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.781+0000 7f73f0191640 1 -- 172.21.15.29:0/3387219561 wait complete. 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.781+0000 7f73f0191640 10 monclient: build_initial_monmap 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.782+0000 7f73f0191640 10 monclient: monmap: 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:last_changed 0.000000 2024-04-09T12:04:33.791 INFO:teuthology.misc.health.smithi029.stderr:created 0.000000 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.782+0000 7f73f0191640 1 librados: starting msgr at 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.782+0000 7f73f0191640 1 librados: starting objecter 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.782+0000 7f73f0191640 1 Processor -- start 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.782+0000 7f73f0191640 1 -- start start 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.782+0000 7f73f0191640 1 librados: setting wanted keys 2024-04-09T12:04:33.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.782+0000 7f73f0191640 1 librados: calling monclient init 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.782+0000 7f73f0191640 10 monclient: init 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73e80b1040 0x7f73e81458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 10 monclient(hunting): picked mon.noname-b con 0x7f73e80b1040 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73e80b7c80 0x7f73e81d6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 10 monclient(hunting): picked mon.noname-a con 0x7f73e80b7c80 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e81d6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 10 monclient(hunting): picked mon.noname-c con 0x7f73e813eb00 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8143960 con 0x7f73e80b7c80 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:33.793 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e81435f0 con 0x7f73e80b1040 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8145130 con 0x7f73e813eb00 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73f0191640 10 monclient(hunting): authenticate will time out at 1339.903143s 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73ee72e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e81d6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73ed72c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73e80b7c80 0x7f73e81d6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73ee72e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e81d6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:58404/0 (socket says 172.21.15.29:58404) 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73ee72e640 1 -- 172.21.15.29:0/3007860460 learned_addr learned my addr 172.21.15.29:0/3007860460 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73ee72e640 10 monclient(hunting): get_auth_request con 0x7f73e813eb00 auth_method 0 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73ee72e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73ee72e640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:33.794 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.783+0000 7f73ee72e640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:33.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.784+0000 7f73ed72c640 10 monclient(hunting): get_auth_request con 0x7f73e80b7c80 auth_method 0 2024-04-09T12:04:33.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.784+0000 7f73ed72c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:33.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.784+0000 7f73ed72c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:33.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.784+0000 7f73ed72c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:33.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.784+0000 7f73ee72e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:33.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.784+0000 7f73ee72e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:33.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.784+0000 7f73ee72e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:33.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.784+0000 7f73ed72c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:33.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.784+0000 7f73ed72c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:33.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.784+0000 7f73ed72c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:33.796 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.785+0000 7f73edf2d640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73e80b1040 0x7f73e81458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:33.796 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.786+0000 7f73edf2d640 10 monclient(hunting): get_auth_request con 0x7f73e80b1040 auth_method 0 2024-04-09T12:04:33.796 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.786+0000 7f73edf2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.786+0000 7f73edf2d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.786+0000 7f73edf2d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.786+0000 7f73edf2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.786+0000 7f73edf2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.786+0000 7f73edf2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.788+0000 7f73ee72e640 10 monclient(hunting): handle_auth_done global_id 4181 payload 824 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.788+0000 7f73ee72e640 1 -- 172.21.15.29:0/3007860460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73e80b1040 msgr2=0x7f73e81458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.788+0000 7f73ee72e640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73e80b1040 0x7f73e81458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.788+0000 7f73ee72e640 1 -- 172.21.15.29:0/3007860460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73e80b7c80 msgr2=0x7f73e81d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.788+0000 7f73ee72e640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73e80b7c80 0x7f73e81d6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.788+0000 7f73ee72e640 10 monclient: _finish_hunting 0 2024-04-09T12:04:33.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.788+0000 7f73ee72e640 1 monclient: found mon.noname-c 2024-04-09T12:04:33.798 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.788+0000 7f73ee72e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:33.798 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.788+0000 7f73ee72e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:04:33.798 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.788+0000 7f73ee72e640 1 -- 172.21.15.29:0/3007860460 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e0009b30 con 0x7f73e813eb00 2024-04-09T12:04:33.798 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.791+0000 7f73ee72e640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e81d6860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f73e0036040 tx=0x7f73e0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:33.798 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.791+0000 7f73de7fc640 10 client.?.objecter ms_handle_connect 0x7f73e813eb00 2024-04-09T12:04:33.798 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.791+0000 7f73de7fc640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:33.799 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 1 -- 172.21.15.29:0/3007860460 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e003e430 con 0x7f73e813eb00 2024-04-09T12:04:33.799 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 10 monclient: dump: 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:33.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 10 monclient: _finish_auth 0 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 10 monclient: _check_auth_tickets 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 1 -- 172.21.15.29:0/3007860460 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e003e590 con 0x7f73e813eb00 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 1 -- 172.21.15.29:0/3007860460 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e003e940 con 0x7f73e813eb00 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73f0191640 5 monclient: authenticate success, global_id 4181 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73de7fc640 10 monclient: dump: 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:33.801 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:33.802 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:33.802 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:33.802 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:33.802 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:33.802 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:33.802 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:33.802 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73f0191640 10 monclient: _renew_subs 2024-04-09T12:04:33.802 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73dffff640 4 set_mon_vals no callback set 2024-04-09T12:04:33.802 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73f0191640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:33.802 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73f0191640 1 -- 172.21.15.29:0/3007860460 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e81383e0 con 0x7f73e813eb00 2024-04-09T12:04:33.803 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73f0191640 10 client.4181.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:33.803 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73f0191640 10 monclient: _renew_subs 2024-04-09T12:04:33.803 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.794+0000 7f73f0191640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:33.803 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.795+0000 7f73f0191640 1 -- 172.21.15.29:0/3007860460 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e81430a0 con 0x7f73e813eb00 2024-04-09T12:04:33.803 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.795+0000 7f73f0191640 1 librados: init done 2024-04-09T12:04:33.803 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.795+0000 7f73f0191640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:33.803 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.795+0000 7f73f0191640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:33.803 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.795+0000 7f73f0191640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:33.803 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.795+0000 7f73f0191640 1 -- 172.21.15.29:0/3007860460 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e8144f90 con 0x7f73e813eb00 2024-04-09T12:04:33.804 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:09.857 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.818 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.814+0000 7f73de7fc640 1 -- 172.21.15.29:0/3007860460 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f73e003eaa0 con 0x7f73e813eb00 2024-04-09T12:04:33.818 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.815+0000 7f73de7fc640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f73cc06c550 0x7f73cc06ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:33.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.815+0000 7f73edf2d640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f73cc06c550 0x7f73cc06ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:33.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.815+0000 7f73edf2d640 10 monclient: get_auth_request con 0x7f73cc06c550 auth_method 0 2024-04-09T12:04:33.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.816+0000 7f73edf2d640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f73cc06c550 0x7f73cc06ea10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009b40 tx=0x7f73e4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:33.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.816+0000 7f73de7fc640 10 client.4181.objecter ms_handle_connect 0x7f73cc06c550 2024-04-09T12:04:33.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.817+0000 7f73de7fc640 1 -- 172.21.15.29:0/3007860460 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f73e007b1a0 con 0x7f73e813eb00 2024-04-09T12:04:33.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.817+0000 7f73de7fc640 10 client.4181.objecter ms_dispatch 0x7f73e8000b90 osd_map(10..10 src has 1..10) v4 2024-04-09T12:04:33.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.817+0000 7f73de7fc640 3 client.4181.objecter handle_osd_map got epochs [10,10] > 0 2024-04-09T12:04:33.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.817+0000 7f73de7fc640 3 client.4181.objecter handle_osd_map decoding full epoch 10 2024-04-09T12:04:33.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:33.817+0000 7f73de7fc640 20 client.4181.objecter dump_active .. 0 homeless 2024-04-09T12:04:33.828 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:09.872 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.838 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:09.896 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.975 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:10.036 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:33.978 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:10.032 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.018 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:10.075 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.041 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:10.091 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.070 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:10.130 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.075 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:10.133 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.094 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:10.138 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.101 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.098+0000 7f73de7fc640 1 -- 172.21.15.29:0/3007860460 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f73e00774e0 con 0x7f73e813eb00 2024-04-09T12:04:34.101 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.098+0000 7f73de7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:34.101 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.098+0000 7f73de7fc640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:34.108 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:10.166 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.266 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:10.319 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.269 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:10.330 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.283 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.280+0000 7f73f0191640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:34.283 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.280+0000 7f73f0191640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:34.284 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.280+0000 7f73f0191640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:34.284 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.280+0000 7f73f0191640 1 -- 172.21.15.29:0/3007860460 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73e8143aa0 con 0x7f73e813eb00 2024-04-09T12:04:34.289 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:10.346 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.300 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.297+0000 7f73de7fc640 1 -- 172.21.15.29:0/3007860460 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f73e8143aa0 con 0x7f73e813eb00 2024-04-09T12:04:34.300 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.297+0000 7f73de7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:34.300 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.297+0000 7f73de7fc640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:34.300 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-09T12:04:34.300 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"1673ebad-34a7-414e-b498-c4f5250b317b","created":"2024-04-09T12:04:18.271948+0000","modified":"2024-04-09T12:04:23.695144+0000","last_up_change":"0.000000","last_in_change":"2024-04-09T12:04:23.695144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c929787-7de5-4d2f-9b36-3a165fa73386","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54d0b5c7-3415-4585-8a9b-c67a8ae94ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a343481-8465-4e19-989c-4a62c926338c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7f553202-73e9-496c-893f-185c61f66807","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84050623-d3f3-40ba-b63e-92d56a74bfd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"883e841f-8acc-4268-8e64-c556b10befa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"126085be-23ad-45b6-951d-47886bdfa75c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-09T12:04:34.303 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 10 librados: watch_flush enter 2024-04-09T12:04:34.303 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 10 librados: watch_flush exit 2024-04-09T12:04:34.303 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 20 client.4181.objecter shutdown clearing up homeless session... 2024-04-09T12:04:34.303 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 10 client.4181.objecter successfully canceled tick 2024-04-09T12:04:34.303 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 -- 172.21.15.29:0/3007860460 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f73cc06c550 msgr2=0x7f73cc06ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:34.303 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f73cc06c550 0x7f73cc06ea10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009b40 tx=0x7f73e4009190 comp rx=0 tx=0).stop 2024-04-09T12:04:34.303 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 10 monclient: shutdown 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 -- 172.21.15.29:0/3007860460 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 msgr2=0x7f73e81d6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e81d6860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f73e0036040 tx=0x7f73e0004a40 comp rx=0 tx=0).stop 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 -- 172.21.15.29:0/3007860460 shutdown_connections 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f73cc06c550 0x7f73cc06ea10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f73e813eb00 0x7f73e81d6860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73e80b7c80 0x7f73e81d6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 --2- 172.21.15.29:0/3007860460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73e80b1040 0x7f73e81458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 -- 172.21.15.29:0/3007860460 >> 172.21.15.29:0/3007860460 conn(0x7f73e8071b70 msgr2=0x7f73e80b71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 -- 172.21.15.29:0/3007860460 shutdown_connections 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 -- 172.21.15.29:0/3007860460 wait complete. 2024-04-09T12:04:34.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:34.299+0000 7f73f0191640 1 librados: shutdown 2024-04-09T12:04:34.312 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-09T12:04:34.313 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:10.363 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.339 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:10.397 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.357 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:10.401 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.366 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:10.426 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.384 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:10.442 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.555 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:10.608 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.559 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:10.616 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.566 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:10.627 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.589 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:10.639 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.610 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:10.668 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.621 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:10.665 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.653 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:10.711 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.658 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:10.719 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.824 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:10.880 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.843 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:10.896 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.859 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:10.909 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.864 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:10.925 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.881 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:10.939 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.888 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:10.932 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:34.959 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:11.019 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.088 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:11.145 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.122 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:11.180 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.124 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:11.174 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.161 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:11.222 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.164 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:11.208 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.176 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:11.235 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.405 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:11.463 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.414 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:11.467 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.460 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:11.521 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.460 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:11.518 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.468 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:11.522 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.503 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:11.563 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.589 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:11.646 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.601 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:11.662 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.645 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:11.702 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.649 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:11.699 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.681 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:11.725 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.718 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:11.766 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:35.738 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:11.782 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:36.016 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:12.077 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:36.072 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:12.133 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:40.654 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:16.711 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:40.840 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:16.898 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:40.977 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:17.030 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:41.106 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:17.156 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:41.120 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-09T12:04:41.181 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:17.225 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:41.211 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.207+0000 7fb43ec6e640 10 monclient: get_monmap_and_config 2024-04-09T12:04:41.211 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.207+0000 7fb43ec6e640 10 monclient: build_initial_monmap 2024-04-09T12:04:41.211 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.207+0000 7fb43ec6e640 10 monclient: monmap: 2024-04-09T12:04:41.211 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:04:41.211 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:41.211 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:04:41.209347+0000 2024-04-09T12:04:41.211 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:04:41.209347+0000 2024-04-09T12:04:41.211 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:41.211 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:41.212 INFO:teuthology.misc.health.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:41.212 INFO:teuthology.misc.health.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:41.212 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:41.212 INFO:teuthology.misc.health.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:41.212 INFO:teuthology.misc.health.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:41.212 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:41.214 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.208+0000 7fb43ec6e640 1 Processor -- start 2024-04-09T12:04:41.214 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.208+0000 7fb43ec6e640 1 -- start start 2024-04-09T12:04:41.214 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.208+0000 7fb43ec6e640 10 monclient: init 2024-04-09T12:04:41.214 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 10 monclient: _add_conns ranks=[0,3,1,2,4] 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb4380b7c80 addr v1:172.21.15.29:6789/0 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4380b1040 0x7fb4380a9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 10 monclient(hunting): picked mon.noname-a con 0x7fb4380b1040 addr v2:172.21.15.29:3300/0 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb43813eb00 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4380aa3d0 con 0x7fb4380b7c80 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4380aa920 con 0x7fb43813eb00 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4380a8f10 con 0x7fb4380b1040 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb43ec6e640 10 monclient(hunting): authenticate will time out at 1347.329592s 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.209+0000 7fb437fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4380b1040 0x7fb4380a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.210+0000 7fb43d20b640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb43813eb00 0x7fb43813ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:41166/0 (socket says 172.21.15.29:41166) 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.210+0000 7fb43d20b640 1 -- 172.21.15.29:0/1451121472 learned_addr learned my addr 172.21.15.29:0/1451121472 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:04:41.215 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.210+0000 7fb437fff640 10 monclient(hunting): get_auth_request con 0x7fb4380b1040 auth_method 0 2024-04-09T12:04:41.216 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.210+0000 7fb437fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:41.216 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.210+0000 7fb437fff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:41.216 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.210+0000 7fb437fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:41.216 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.210+0000 7fb437fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:41.216 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.210+0000 7fb437fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:41.216 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.210+0000 7fb437fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:41.217 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.213+0000 7fb437fff640 10 monclient(hunting): handle_auth_done global_id 4182 payload 274 2024-04-09T12:04:41.217 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.213+0000 7fb437fff640 1 -- 172.21.15.29:0/1451121472 >> v1:172.21.15.173:6789/0 conn(0x7fb43813eb00 legacy=0x7fb43813ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:41.217 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.213+0000 7fb437fff640 1 -- 172.21.15.29:0/1451121472 >> v1:172.21.15.29:6789/0 conn(0x7fb4380b7c80 legacy=0x7fb4381418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:41.217 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.213+0000 7fb437fff640 10 monclient: _finish_hunting 0 2024-04-09T12:04:41.217 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.213+0000 7fb437fff640 1 monclient: found mon.noname-a 2024-04-09T12:04:41.217 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.213+0000 7fb437fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:41.217 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.213+0000 7fb437fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:04:41.217 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.213+0000 7fb437fff640 1 -- 172.21.15.29:0/1451121472 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4380aa640 con 0x7fb4380b1040 2024-04-09T12:04:41.220 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:17.277 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:41.221 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.218+0000 7fb437fff640 1 --2- 172.21.15.29:0/1451121472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4380b1040 0x7fb4380a9330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb4240097a0 tx=0x7fb42402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408819764c6006e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:41.225 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 1 -- 172.21.15.29:0/1451121472 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424031830 con 0x7fb4380b1040 2024-04-09T12:04:41.225 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:41.225 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:04:41.225 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 10 monclient: dump: 2024-04-09T12:04:41.225 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 10 monclient: _finish_auth 0 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 10 monclient: _check_auth_tickets 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 1 -- 172.21.15.29:0/1451121472 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb424031990 con 0x7fb4380b1040 2024-04-09T12:04:41.226 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 1 -- 172.21.15.29:0/1451121472 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424031d20 con 0x7fb4380b1040 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb4377fe640 10 monclient: dump: 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:41.227 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:41.228 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:41.228 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb43ec6e640 5 monclient: authenticate success, global_id 4182 2024-04-09T12:04:41.228 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb43ec6e640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:41.228 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.222+0000 7fb43ec6e640 4 set_mon_vals no callback set 2024-04-09T12:04:41.232 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.223+0000 7fb43ec6e640 10 monclient: shutdown 2024-04-09T12:04:41.232 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.223+0000 7fb43ec6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:41.232 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.223+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1451121472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4380b1040 msgr2=0x7fb4380a9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:41.232 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.223+0000 7fb43ec6e640 1 --2- 172.21.15.29:0/1451121472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4380b1040 0x7fb4380a9330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb4240097a0 tx=0x7fb42402b8d0 comp rx=0 tx=0).stop 2024-04-09T12:04:41.232 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.223+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1451121472 shutdown_connections 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.223+0000 7fb43ec6e640 1 --2- 172.21.15.29:0/1451121472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4380b1040 0x7fb4380a9330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.223+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1451121472 >> 172.21.15.29:0/1451121472 conn(0x7fb438071b70 msgr2=0x7fb4380b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.223+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1451121472 shutdown_connections 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.223+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1451121472 wait complete. 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.224+0000 7fb43ec6e640 10 monclient: build_initial_monmap 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.224+0000 7fb43ec6e640 10 monclient: monmap: 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:last_changed 0.000000 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:created 0.000000 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:41.233 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.224+0000 7fb43ec6e640 1 librados: starting msgr at 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.224+0000 7fb43ec6e640 1 librados: starting objecter 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.224+0000 7fb43ec6e640 1 Processor -- start 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.224+0000 7fb43ec6e640 1 -- start start 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.224+0000 7fb43ec6e640 1 librados: setting wanted keys 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.224+0000 7fb43ec6e640 1 librados: calling monclient init 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.224+0000 7fb43ec6e640 10 monclient: init 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4380b1040 0x7fb4381346d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:41.234 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 10 monclient(hunting): picked mon.noname-c con 0x7fb4380b1040 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4380b7c80 0x7fb438139a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 10 monclient(hunting): picked mon.noname-a con 0x7fb4380b7c80 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb43813eb00 0x7fb438139fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 10 monclient(hunting): picked mon.noname-b con 0x7fb43813eb00 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4381395f0 con 0x7fb4380b7c80 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb438135650 con 0x7fb43813eb00 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb438135930 con 0x7fb4380b1040 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.225+0000 7fb43ec6e640 10 monclient(hunting): authenticate will time out at 1347.345715s 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43d20b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb43813eb00 0x7fb438139fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:41.235 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb437fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4380b7c80 0x7fb438139a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43d20b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb43813eb00 0x7fb438139fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:57624/0 (socket says 172.21.15.29:57624) 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43d20b640 1 -- 172.21.15.29:0/1897259390 learned_addr learned my addr 172.21.15.29:0/1897259390 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43d20b640 10 monclient(hunting): get_auth_request con 0x7fb43813eb00 auth_method 0 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43d20b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43d20b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43d20b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43ca0a640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4380b1040 0x7fb4381346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43ca0a640 10 monclient(hunting): get_auth_request con 0x7fb4380b1040 auth_method 0 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43ca0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43ca0a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb43ca0a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb437fff640 10 monclient(hunting): get_auth_request con 0x7fb4380b7c80 auth_method 0 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb437fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:41.236 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb437fff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:41.237 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.226+0000 7fb437fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:41.237 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.227+0000 7fb43d20b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:41.237 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.227+0000 7fb43d20b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:41.237 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.227+0000 7fb43d20b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:41.237 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.227+0000 7fb43ca0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:41.237 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.227+0000 7fb43ca0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:41.237 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.227+0000 7fb43ca0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:41.237 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.227+0000 7fb437fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:41.237 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.227+0000 7fb437fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:41.237 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.227+0000 7fb437fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:41.238 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.230+0000 7fb437fff640 10 monclient(hunting): handle_auth_done global_id 4185 payload 824 2024-04-09T12:04:41.238 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.230+0000 7fb437fff640 1 -- 172.21.15.29:0/1897259390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4380b1040 msgr2=0x7fb4381346d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:41.241 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.230+0000 7fb437fff640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4380b1040 0x7fb4381346d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:41.241 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.230+0000 7fb437fff640 1 -- 172.21.15.29:0/1897259390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb43813eb00 msgr2=0x7fb438139fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:41.241 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.230+0000 7fb437fff640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb43813eb00 0x7fb438139fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:41.242 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.230+0000 7fb437fff640 10 monclient: _finish_hunting 0 2024-04-09T12:04:41.242 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.230+0000 7fb437fff640 1 monclient: found mon.noname-a 2024-04-09T12:04:41.242 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.230+0000 7fb437fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:41.242 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.230+0000 7fb437fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:04:41.242 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.230+0000 7fb437fff640 1 -- 172.21.15.29:0/1897259390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424009400 con 0x7fb4380b7c80 2024-04-09T12:04:41.242 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.233+0000 7fb437fff640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4380b7c80 0x7fb438139a80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb424033000 tx=0x7fb4240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:41.242 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.233+0000 7fb4357fa640 10 client.?.objecter ms_handle_connect 0x7fb4380b7c80 2024-04-09T12:04:41.242 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.233+0000 7fb4357fa640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:41.244 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 1 -- 172.21.15.29:0/1897259390 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42403bbf0 con 0x7fb4380b7c80 2024-04-09T12:04:41.244 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:41.244 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:04:41.244 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 10 monclient: dump: 2024-04-09T12:04:41.244 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:41.244 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:41.244 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:41.244 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:41.244 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:41.244 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 10 monclient: _finish_auth 0 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 10 monclient: _check_auth_tickets 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 1 -- 172.21.15.29:0/1897259390 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42403bd70 con 0x7fb4380b7c80 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 1 -- 172.21.15.29:0/1897259390 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424045630 con 0x7fb4380b7c80 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb4357fa640 10 monclient: dump: 2024-04-09T12:04:41.245 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.238+0000 7fb436ffd640 4 set_mon_vals no callback set 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.239+0000 7fb43ec6e640 5 monclient: authenticate success, global_id 4185 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.239+0000 7fb43ec6e640 10 monclient: _renew_subs 2024-04-09T12:04:41.246 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.239+0000 7fb43ec6e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:41.247 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.239+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1897259390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb438139180 con 0x7fb4380b7c80 2024-04-09T12:04:41.247 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.239+0000 7fb43ec6e640 10 client.4185.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:41.247 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.239+0000 7fb43ec6e640 10 monclient: _renew_subs 2024-04-09T12:04:41.247 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.239+0000 7fb43ec6e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:41.247 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.239+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1897259390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43813c2d0 con 0x7fb4380b7c80 2024-04-09T12:04:41.247 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.239+0000 7fb43ec6e640 1 librados: init done 2024-04-09T12:04:41.247 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.240+0000 7fb43ec6e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:41.247 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.240+0000 7fb43ec6e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:41.247 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.240+0000 7fb43ec6e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:41.247 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.240+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1897259390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43804e160 con 0x7fb4380b7c80 2024-04-09T12:04:41.277 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.272+0000 7fb4357fa640 1 -- 172.21.15.29:0/1897259390 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fb42404e450 con 0x7fb4380b7c80 2024-04-09T12:04:41.277 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.272+0000 7fb4357fa640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fb41c06c550 0x7fb41c06ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:41.277 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.273+0000 7fb43ca0a640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fb41c06c550 0x7fb41c06ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:41.278 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.273+0000 7fb43ca0a640 10 monclient: get_auth_request con 0x7fb41c06c550 auth_method 0 2024-04-09T12:04:41.278 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.273+0000 7fb43ca0a640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fb41c06c550 0x7fb41c06ea10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb42c004f60 tx=0x7fb42c007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:41.278 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.273+0000 7fb4357fa640 10 client.4185.objecter ms_handle_connect 0x7fb41c06c550 2024-04-09T12:04:41.382 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:17.442 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:41.634 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:17.695 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:41.706 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.703+0000 7fb4357fa640 1 -- 172.21.15.29:0/1897259390 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb42407a630 con 0x7fb4380b7c80 2024-04-09T12:04:41.706 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.703+0000 7fb4357fa640 10 client.4185.objecter ms_dispatch 0x7fb438000b90 osd_map(10..10 src has 1..10) v4 2024-04-09T12:04:41.707 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.703+0000 7fb4357fa640 3 client.4185.objecter handle_osd_map got epochs [10,10] > 0 2024-04-09T12:04:41.707 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.703+0000 7fb4357fa640 3 client.4185.objecter handle_osd_map decoding full epoch 10 2024-04-09T12:04:41.707 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.703+0000 7fb4357fa640 20 client.4185.objecter dump_active .. 0 homeless 2024-04-09T12:04:41.707 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.703+0000 7fb4357fa640 1 -- 172.21.15.29:0/1897259390 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fb424076970 con 0x7fb4380b7c80 2024-04-09T12:04:41.707 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.703+0000 7fb4357fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:41.707 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.703+0000 7fb4357fa640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:41.942 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.939+0000 7fb43ec6e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:41.942 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.939+0000 7fb43ec6e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:41.942 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.939+0000 7fb43ec6e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:04:41.942 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.939+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1897259390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb43813e590 con 0x7fb4380b7c80 2024-04-09T12:04:41.959 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.956+0000 7fb4357fa640 1 -- 172.21.15.29:0/1897259390 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb424035090 con 0x7fb4380b7c80 2024-04-09T12:04:41.959 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.956+0000 7fb4357fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:41.959 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.956+0000 7fb4357fa640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:41.960 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-09T12:04:41.960 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"1673ebad-34a7-414e-b498-c4f5250b317b","created":"2024-04-09T12:04:18.271948+0000","modified":"2024-04-09T12:04:23.695144+0000","last_up_change":"0.000000","last_in_change":"2024-04-09T12:04:23.695144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c929787-7de5-4d2f-9b36-3a165fa73386","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54d0b5c7-3415-4585-8a9b-c67a8ae94ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a343481-8465-4e19-989c-4a62c926338c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7f553202-73e9-496c-893f-185c61f66807","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84050623-d3f3-40ba-b63e-92d56a74bfd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"883e841f-8acc-4268-8e64-c556b10befa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"126085be-23ad-45b6-951d-47886bdfa75c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-09T12:04:41.962 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 10 librados: watch_flush enter 2024-04-09T12:04:41.962 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 10 librados: watch_flush exit 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 20 client.4185.objecter shutdown clearing up homeless session... 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 10 client.4185.objecter successfully canceled tick 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1897259390 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fb41c06c550 msgr2=0x7fb41c06ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fb41c06c550 0x7fb41c06ea10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb42c004f60 tx=0x7fb42c007e30 comp rx=0 tx=0).stop 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 10 monclient: shutdown 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1897259390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4380b7c80 msgr2=0x7fb438139a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4380b7c80 0x7fb438139a80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb424033000 tx=0x7fb4240046c0 comp rx=0 tx=0).stop 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1897259390 shutdown_connections 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fb41c06c550 0x7fb41c06ea10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb43813eb00 0x7fb438139fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4380b7c80 0x7fb438139a80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 --2- 172.21.15.29:0/1897259390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4380b1040 0x7fb4381346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:41.963 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1897259390 >> 172.21.15.29:0/1897259390 conn(0x7fb438071b70 msgr2=0x7fb4380b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:41.964 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1897259390 shutdown_connections 2024-04-09T12:04:41.964 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 -- 172.21.15.29:0/1897259390 wait complete. 2024-04-09T12:04:41.964 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:41.959+0000 7fb43ec6e640 1 librados: shutdown 2024-04-09T12:04:41.975 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-09T12:04:46.069 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:22.127 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:46.073 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:22.131 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:46.250 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:22.304 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:46.256 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:22.310 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:46.362 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:22.420 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:46.366 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:22.424 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:46.890 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:22.950 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:46.895 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:22.956 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:47.144 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:23.193 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:47.147 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:23.197 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:47.262 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:23.318 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:47.268 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:23.325 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:47.450 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:23.494 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:47.456 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:23.500 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:47.568 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:23.630 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:47.573 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:23.634 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:48.782 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-09T12:04:48.879 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.877+0000 7f3d483c0640 10 monclient: get_monmap_and_config 2024-04-09T12:04:48.879 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.877+0000 7f3d483c0640 10 monclient: build_initial_monmap 2024-04-09T12:04:48.879 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.877+0000 7f3d483c0640 10 monclient: monmap: 2024-04-09T12:04:48.879 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:04:48.879 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:48.880 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:04:48.877804+0000 2024-04-09T12:04:48.880 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:04:48.877804+0000 2024-04-09T12:04:48.880 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:48.880 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:48.880 INFO:teuthology.misc.health.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:48.880 INFO:teuthology.misc.health.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:48.880 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:48.880 INFO:teuthology.misc.health.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:48.880 INFO:teuthology.misc.health.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:48.880 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:48.882 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.877+0000 7f3d483c0640 1 Processor -- start 2024-04-09T12:04:48.882 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.878+0000 7f3d483c0640 1 -- start start 2024-04-09T12:04:48.882 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.878+0000 7f3d483c0640 10 monclient: init 2024-04-09T12:04:48.882 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.878+0000 7f3d483c0640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:48.882 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.878+0000 7f3d483c0640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2024-04-09T12:04:48.882 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.878+0000 7f3d483c0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3d400a8f10 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:48.882 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.878+0000 7f3d483c0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3d40141920 addr v1:172.21.15.29:6789/0 2024-04-09T12:04:48.882 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.878+0000 7f3d483c0640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3d4013ea20 0x7f3d4013ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:48.882 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.878+0000 7f3d483c0640 10 monclient(hunting): picked mon.noname-c con 0x7f3d4013ea20 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:48.882 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.879+0000 7f3d483c0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d40141e40 con 0x7f3d40141920 2024-04-09T12:04:48.882 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.879+0000 7f3d483c0640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d400aa640 con 0x7f3d400a8f10 2024-04-09T12:04:48.883 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.879+0000 7f3d483c0640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:48.883 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.879+0000 7f3d483c0640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d400a92f0 con 0x7f3d4013ea20 2024-04-09T12:04:48.883 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.879+0000 7f3d483c0640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:48.883 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.879+0000 7f3d483c0640 10 monclient(hunting): authenticate will time out at 1354.998047s 2024-04-09T12:04:48.883 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.879+0000 7f3d4615c640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3d400a8f10 0x7f3d401422d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:53912/0 (socket says 172.21.15.29:53912) 2024-04-09T12:04:48.883 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.879+0000 7f3d4615c640 1 -- 172.21.15.29:0/1826286136 learned_addr learned my addr 172.21.15.29:0/1826286136 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:04:48.885 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157999018 0 0) 0x7f3d40141e40 con 0x7f3d40141920 2024-04-09T12:04:48.885 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 10 monclient(hunting): _negotiate 2024-04-09T12:04:48.885 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:48.885 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:48.885 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 10 monclient(hunting): my global_id is 4188 2024-04-09T12:04:48.885 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d2c003520 con 0x7f3d40141920 2024-04-09T12:04:48.885 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4695d640 1 --2- 172.21.15.29:0/1826286136 >> v2:172.21.15.173:3300/0 conn(0x7f3d4013ea20 0x7f3d4013ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:48.885 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082171344 0 0) 0x7f3d400aa640 con 0x7f3d400a8f10 2024-04-09T12:04:48.885 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 10 monclient(hunting): _negotiate 2024-04-09T12:04:48.886 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:48.886 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:48.886 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 10 monclient(hunting): my global_id is 4234 2024-04-09T12:04:48.886 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.882+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d40141e40 con 0x7f3d400a8f10 2024-04-09T12:04:48.886 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.883+0000 7f3d4695d640 10 monclient(hunting): get_auth_request con 0x7f3d4013ea20 auth_method 0 2024-04-09T12:04:48.886 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.883+0000 7f3d4695d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:48.886 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.883+0000 7f3d4695d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:48.886 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.883+0000 7f3d4695d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:48.887 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.883+0000 7f3d4695d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:48.887 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.883+0000 7f3d4695d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:48.887 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.883+0000 7f3d4695d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:48.890 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 902272538 0 0) 0x7f3d2c003520 con 0x7f3d40141920 2024-04-09T12:04:48.890 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 >> v2:172.21.15.173:3300/0 conn(0x7f3d4013ea20 msgr2=0x7f3d4013ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:48.890 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 1 --2- 172.21.15.29:0/1826286136 >> v2:172.21.15.173:3300/0 conn(0x7f3d4013ea20 0x7f3d4013ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:48.890 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 >> v1:172.21.15.173:6789/0 conn(0x7f3d400a8f10 legacy=0x7f3d401422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:48.890 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 10 monclient: _finish_hunting 0 2024-04-09T12:04:48.890 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 1 monclient: found mon.noname-a-legacy 2024-04-09T12:04:48.890 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:48.890 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.29:6789/0 2024-04-09T12:04:48.890 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400aa920 con 0x7f3d40141920 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 10 monclient: _finish_auth 0 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 10 monclient: _check_auth_tickets 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412254180 0 0) 0x7f3d30001670 con 0x7f3d40141920 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 10 monclient: dump: 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:48.891 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] but i'm connected to v1:172.21.15.29:6789/0, reconnecting 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 >> v1:172.21.15.29:6789/0 conn(0x7f3d40141920 legacy=0x7f3d400b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 1 --2- 172.21.15.29:0/1826286136 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d2c003be0 0x7f3d2c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 10 monclient(hunting): picked mon.c con 0x7f3d2c003be0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 1 --2- 172.21.15.29:0/1826286136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d2c0047c0 0x7f3d2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.886+0000 7f3d4515a640 10 monclient(hunting): picked mon.b con 0x7f3d2c0047c0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.887+0000 7f3d4515a640 1 --2- 172.21.15.29:0/1826286136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d2c005350 0x7f3d2c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.887+0000 7f3d4515a640 10 monclient(hunting): picked mon.a con 0x7f3d2c005350 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:48.892 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.887+0000 7f3d4515a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.887+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400a92f0 con 0x7f3d2c005350 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.887+0000 7f3d4515a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.887+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c00c220 con 0x7f3d2c0047c0 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.887+0000 7f3d4515a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.887+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c00c3e0 con 0x7f3d2c003be0 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.887+0000 7f3d4515a640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.887+0000 7f3d4515a640 10 monclient(hunting): _finish_auth 0 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.887+0000 7f3d4615c640 1 --2- 172.21.15.29:0/1826286136 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d2c003be0 0x7f3d2c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.888+0000 7f3d4615c640 10 monclient(hunting): get_auth_request con 0x7f3d2c003be0 auth_method 0 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.888+0000 7f3d4615c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.888+0000 7f3d4615c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.888+0000 7f3d4615c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:48.893 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.888+0000 7f3d4695d640 1 --2- 172.21.15.29:0/1826286136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d2c005350 0x7f3d2c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.888+0000 7f3d4615c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.888+0000 7f3d4615c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.888+0000 7f3d4615c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.890+0000 7f3d4695d640 10 monclient(hunting): get_auth_request con 0x7f3d2c005350 auth_method 0 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.890+0000 7f3d4695d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.890+0000 7f3d4695d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.890+0000 7f3d4695d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 10 monclient(hunting): handle_auth_done global_id 4188 payload 293 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 1 -- 172.21.15.29:0/1826286136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d2c0047c0 msgr2=0x7f3d2c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 1 --2- 172.21.15.29:0/1826286136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d2c0047c0 0x7f3d2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 1 -- 172.21.15.29:0/1826286136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d2c005350 msgr2=0x7f3d2c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 1 --2- 172.21.15.29:0/1826286136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d2c005350 0x7f3d2c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:48.895 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 10 monclient: _finish_hunting 0 2024-04-09T12:04:48.896 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 1 monclient: found mon.c 2024-04-09T12:04:48.896 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:48.896 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:48.896 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 1 -- 172.21.15.29:0/1826286136 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c003520 con 0x7f3d2c003be0 2024-04-09T12:04:48.896 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 10 monclient: _finish_auth 0 2024-04-09T12:04:48.896 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 10 monclient: _check_auth_tickets 2024-04-09T12:04:48.896 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d4615c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:48.896 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d483c0640 5 monclient: authenticate success, global_id 4188 2024-04-09T12:04:48.896 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.891+0000 7f3d483c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:48.896 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.892+0000 7f3d4695d640 1 -- 172.21.15.29:0/1826286136 reap_dead start 2024-04-09T12:04:48.897 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.894+0000 7f3d4615c640 1 --2- 172.21.15.29:0/1826286136 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d2c003be0 0x7f3d2c003fe0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c001980 tx=0x7f3d2c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93cb34f434d8cf52 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:48.903 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c004aa0 con 0x7f3d2c003be0 2024-04-09T12:04:48.903 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d4515a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:48.903 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d4515a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:04:48.903 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d4515a640 10 monclient: dump: 2024-04-09T12:04:48.903 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:48.903 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:48.903 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:48.903 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:48.903 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:48.903 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:48.903 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c02d040 con 0x7f3d2c003be0 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d4515a640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d4515a640 1 -- 172.21.15.29:0/1826286136 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c004e40 con 0x7f3d2c003be0 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d4515a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d4515a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d4515a640 10 monclient: dump: 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:48.904 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d483c0640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d483c0640 4 set_mon_vals no callback set 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d483c0640 10 monclient: shutdown 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d483c0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d483c0640 1 -- 172.21.15.29:0/1826286136 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d2c003be0 msgr2=0x7f3d2c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.899+0000 7f3d483c0640 1 --2- 172.21.15.29:0/1826286136 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d2c003be0 0x7f3d2c003fe0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c001980 tx=0x7f3d2c0057f0 comp rx=0 tx=0).stop 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.900+0000 7f3d483c0640 1 -- 172.21.15.29:0/1826286136 shutdown_connections 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.900+0000 7f3d483c0640 1 --2- 172.21.15.29:0/1826286136 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d2c003be0 0x7f3d2c003fe0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:48.905 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.900+0000 7f3d483c0640 1 -- 172.21.15.29:0/1826286136 >> 172.21.15.29:0/1826286136 conn(0x7f3d400b72d0 msgr2=0x7f3d400b76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.900+0000 7f3d483c0640 1 -- 172.21.15.29:0/1826286136 shutdown_connections 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.900+0000 7f3d483c0640 1 -- 172.21.15.29:0/1826286136 wait complete. 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.901+0000 7f3d483c0640 10 monclient: build_initial_monmap 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.901+0000 7f3d483c0640 10 monclient: monmap: 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:last_changed 0.000000 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:created 0.000000 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:48.906 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:48.912 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.901+0000 7f3d483c0640 1 librados: starting msgr at 2024-04-09T12:04:48.912 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.901+0000 7f3d483c0640 1 librados: starting objecter 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.901+0000 7f3d483c0640 1 Processor -- start 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.902+0000 7f3d483c0640 1 -- start start 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.902+0000 7f3d483c0640 1 librados: setting wanted keys 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.902+0000 7f3d483c0640 1 librados: calling monclient init 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.902+0000 7f3d483c0640 10 monclient: init 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d2c003be0 0x7f3d401ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 10 monclient(hunting): picked mon.noname-b con 0x7f3d2c003be0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d401d64e0 0x7f3d401d6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 10 monclient(hunting): picked mon.noname-c con 0x7f3d401d64e0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d401d9a60 0x7f3d401d9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:48.913 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 10 monclient(hunting): picked mon.noname-a con 0x7f3d401d9a60 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d401cb650 con 0x7f3d401d9a60 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400b0dc0 con 0x7f3d2c003be0 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d401d6ea0 con 0x7f3d401d64e0 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d483c0640 10 monclient(hunting): authenticate will time out at 1355.022608s 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d4615c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d2c003be0 0x7f3d401ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d4595b640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d401d64e0 0x7f3d401d6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d4615c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d2c003be0 0x7f3d401ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:42994/0 (socket says 172.21.15.29:42994) 2024-04-09T12:04:48.914 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d4615c640 1 -- 172.21.15.29:0/1582757692 learned_addr learned my addr 172.21.15.29:0/1582757692 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d4615c640 10 monclient(hunting): get_auth_request con 0x7f3d2c003be0 auth_method 0 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.903+0000 7f3d4615c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4615c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4615c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4695d640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d401d9a60 0x7f3d401d9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4595b640 10 monclient(hunting): get_auth_request con 0x7f3d401d64e0 auth_method 0 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4595b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4595b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4595b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4615c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4615c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4615c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4695d640 10 monclient(hunting): get_auth_request con 0x7f3d401d9a60 auth_method 0 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4695d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4695d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:48.915 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.904+0000 7f3d4695d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:48.916 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.905+0000 7f3d4695d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:48.916 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.905+0000 7f3d4695d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:48.916 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.905+0000 7f3d4695d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:48.916 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.905+0000 7f3d4595b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:48.916 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.905+0000 7f3d4595b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:48.916 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.905+0000 7f3d4595b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:48.916 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.907+0000 7f3d4615c640 10 monclient(hunting): handle_auth_done global_id 4240 payload 824 2024-04-09T12:04:48.916 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.907+0000 7f3d4615c640 1 -- 172.21.15.29:0/1582757692 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d401d64e0 msgr2=0x7f3d401d6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:48.916 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.907+0000 7f3d4615c640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d401d64e0 0x7f3d401d6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:48.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.907+0000 7f3d4615c640 1 -- 172.21.15.29:0/1582757692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d401d9a60 msgr2=0x7f3d401d9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:48.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.907+0000 7f3d4615c640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d401d9a60 0x7f3d401d9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:48.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.907+0000 7f3d4615c640 10 monclient: _finish_hunting 0 2024-04-09T12:04:48.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.907+0000 7f3d4615c640 1 monclient: found mon.noname-b 2024-04-09T12:04:48.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.907+0000 7f3d4615c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:48.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.907+0000 7f3d4615c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:04:48.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.907+0000 7f3d4615c640 1 -- 172.21.15.29:0/1582757692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d401cc930 con 0x7f3d2c003be0 2024-04-09T12:04:48.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.909+0000 7f3d36ffd640 10 client.?.objecter ms_handle_connect 0x7f3d2c003be0 2024-04-09T12:04:48.918 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.909+0000 7f3d36ffd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:48.918 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.910+0000 7f3d4615c640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d2c003be0 0x7f3d401ca7b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c035040 tx=0x7f3d3c0012d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:48.922 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d36ffd640 1 -- 172.21.15.29:0/1582757692 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c03e430 con 0x7f3d2c003be0 2024-04-09T12:04:48.922 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d36ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:48.922 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d36ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:04:48.922 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d36ffd640 10 monclient: dump: 2024-04-09T12:04:48.922 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:48.922 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:48.922 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:48.922 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d36ffd640 10 monclient: _finish_auth 0 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d36ffd640 10 monclient: _check_auth_tickets 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d36ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d483c0640 5 monclient: authenticate success, global_id 4240 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d483c0640 10 monclient: _renew_subs 2024-04-09T12:04:48.923 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d483c0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:48.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d483c0640 1 -- 172.21.15.29:0/1582757692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d400b0850 con 0x7f3d2c003be0 2024-04-09T12:04:48.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d483c0640 10 client.4240.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:48.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d483c0640 10 monclient: _renew_subs 2024-04-09T12:04:48.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.912+0000 7f3d483c0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:48.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.913+0000 7f3d483c0640 1 -- 172.21.15.29:0/1582757692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d401cbc90 con 0x7f3d2c003be0 2024-04-09T12:04:48.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.913+0000 7f3d483c0640 1 librados: init done 2024-04-09T12:04:48.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.914+0000 7f3d483c0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:48.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.914+0000 7f3d483c0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:48.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.914+0000 7f3d483c0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:48.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.914+0000 7f3d483c0640 1 -- 172.21.15.29:0/1582757692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4004e160 con 0x7f3d2c003be0 2024-04-09T12:04:48.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.914+0000 7f3d36ffd640 1 -- 172.21.15.29:0/1582757692 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c03e590 con 0x7f3d2c003be0 2024-04-09T12:04:48.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.914+0000 7f3d36ffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:48.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.914+0000 7f3d44959640 4 set_mon_vals no callback set 2024-04-09T12:04:48.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.914+0000 7f3d36ffd640 1 -- 172.21.15.29:0/1582757692 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c03e430 con 0x7f3d2c003be0 2024-04-09T12:04:48.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.914+0000 7f3d36ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:48.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.914+0000 7f3d36ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:04:48.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:48.914+0000 7f3d36ffd640 10 monclient: dump: 2024-04-09T12:04:48.925 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:48.926 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:48.926 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:48.926 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:48.926 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:48.926 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:48.926 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:48.926 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:48.926 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:48.926 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:49.251 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.249+0000 7f3d36ffd640 1 -- 172.21.15.29:0/1582757692 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f3d3c03e700 con 0x7f3d2c003be0 2024-04-09T12:04:49.251 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.249+0000 7f3d36ffd640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3d2406c5d0 0x7f3d2406ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:49.252 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.250+0000 7f3d4595b640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3d2406c5d0 0x7f3d2406ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:49.252 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.250+0000 7f3d4595b640 10 monclient: get_auth_request con 0x7f3d2406c5d0 auth_method 0 2024-04-09T12:04:49.252 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.250+0000 7f3d36ffd640 10 client.4240.objecter ms_handle_connect 0x7f3d2406c5d0 2024-04-09T12:04:49.252 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.250+0000 7f3d4595b640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3d2406c5d0 0x7f3d2406ea90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3d30000f60 tx=0x7f3d30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:49.318 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.316+0000 7f3d36ffd640 1 -- 172.21.15.29:0/1582757692 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3d3c07a0c0 con 0x7f3d2c003be0 2024-04-09T12:04:49.318 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.316+0000 7f3d36ffd640 10 client.4240.objecter ms_dispatch 0x7f3d40000b90 osd_map(10..10 src has 1..10) v4 2024-04-09T12:04:49.318 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.316+0000 7f3d36ffd640 3 client.4240.objecter handle_osd_map got epochs [10,10] > 0 2024-04-09T12:04:49.318 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.316+0000 7f3d36ffd640 3 client.4240.objecter handle_osd_map decoding full epoch 10 2024-04-09T12:04:49.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.316+0000 7f3d36ffd640 20 client.4240.objecter dump_active .. 0 homeless 2024-04-09T12:04:49.330 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.328+0000 7f3d36ffd640 1 -- 172.21.15.29:0/1582757692 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f3d3c076400 con 0x7f3d2c003be0 2024-04-09T12:04:49.330 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.328+0000 7f3d36ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:49.331 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.328+0000 7f3d36ffd640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:49.599 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.597+0000 7f3d483c0640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:49.599 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.597+0000 7f3d483c0640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:49.599 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.597+0000 7f3d483c0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:04:49.599 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.597+0000 7f3d483c0640 1 -- 172.21.15.29:0/1582757692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d4013c950 con 0x7f3d2c003be0 2024-04-09T12:04:49.666 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.663+0000 7f3d36ffd640 1 -- 172.21.15.29:0/1582757692 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3d3c079a20 con 0x7f3d2c003be0 2024-04-09T12:04:49.666 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.663+0000 7f3d36ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:49.666 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.663+0000 7f3d36ffd640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:49.666 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-09T12:04:49.666 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"1673ebad-34a7-414e-b498-c4f5250b317b","created":"2024-04-09T12:04:18.271948+0000","modified":"2024-04-09T12:04:23.695144+0000","last_up_change":"0.000000","last_in_change":"2024-04-09T12:04:23.695144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c929787-7de5-4d2f-9b36-3a165fa73386","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54d0b5c7-3415-4585-8a9b-c67a8ae94ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a343481-8465-4e19-989c-4a62c926338c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7f553202-73e9-496c-893f-185c61f66807","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84050623-d3f3-40ba-b63e-92d56a74bfd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"883e841f-8acc-4268-8e64-c556b10befa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"126085be-23ad-45b6-951d-47886bdfa75c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-09T12:04:49.669 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 10 librados: watch_flush enter 2024-04-09T12:04:49.669 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 10 librados: watch_flush exit 2024-04-09T12:04:49.669 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 20 client.4240.objecter shutdown clearing up homeless session... 2024-04-09T12:04:49.669 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 10 client.4240.objecter successfully canceled tick 2024-04-09T12:04:49.669 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 -- 172.21.15.29:0/1582757692 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3d2406c5d0 msgr2=0x7f3d2406ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:49.669 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3d2406c5d0 0x7f3d2406ea90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3d30000f60 tx=0x7f3d30009040 comp rx=0 tx=0).stop 2024-04-09T12:04:49.669 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 10 monclient: shutdown 2024-04-09T12:04:49.669 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:49.669 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 -- 172.21.15.29:0/1582757692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d2c003be0 msgr2=0x7f3d401ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:49.669 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d2c003be0 0x7f3d401ca7b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c035040 tx=0x7f3d3c0012d0 comp rx=0 tx=0).stop 2024-04-09T12:04:49.669 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 -- 172.21.15.29:0/1582757692 shutdown_connections 2024-04-09T12:04:49.670 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3d2406c5d0 0x7f3d2406ea90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:49.670 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d401d9a60 0x7f3d401d9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:49.670 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d401d64e0 0x7f3d401d6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:49.670 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 --2- 172.21.15.29:0/1582757692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d2c003be0 0x7f3d401ca7b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:49.670 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 -- 172.21.15.29:0/1582757692 >> 172.21.15.29:0/1582757692 conn(0x7f3d400b72d0 msgr2=0x7f3d4013b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:49.670 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 -- 172.21.15.29:0/1582757692 shutdown_connections 2024-04-09T12:04:49.670 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 -- 172.21.15.29:0/1582757692 wait complete. 2024-04-09T12:04:49.670 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:49.666+0000 7f3d483c0640 1 librados: shutdown 2024-04-09T12:04:49.681 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-09T12:04:50.360 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:26.418 35531== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:50.761 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:26.814 35532== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:51.062 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:27.120 35530== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:51.266 INFO:tasks.ceph.osd.0.smithi029.stderr:==00:00:00:27.312 35238== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:51.651 INFO:tasks.ceph.osd.2.smithi029.stderr:==00:00:00:27.708 35237== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:51.690 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:27.750 35529== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:51.908 INFO:tasks.ceph.osd.3.smithi029.stderr:==00:00:00:27.952 35239== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:52.357 INFO:tasks.ceph.osd.1.smithi029.stderr:==00:00:00:28.418 35236== Warning: unimplemented fcntl command: 1038 2024-04-09T12:04:56.488 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.588+0000 7f9e7f5fb640 10 monclient: get_monmap_and_config 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.588+0000 7f9e7f5fb640 10 monclient: build_initial_monmap 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.588+0000 7f9e7f5fb640 10 monclient: monmap: 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:04:56.589368+0000 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:04:56.589368+0000 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:04:56.591 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:04:56.592 INFO:teuthology.misc.health.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:04:56.592 INFO:teuthology.misc.health.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:04:56.592 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:56.593 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.589+0000 7f9e7f5fb640 1 Processor -- start 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.589+0000 7f9e7f5fb640 1 -- start start 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.589+0000 7f9e7f5fb640 10 monclient: init 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 10 monclient: _add_conns ranks=[4,0,1,3,2] 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9e780a8f10 0x7f9e781422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 10 monclient(hunting): picked mon.noname-c con 0x7f9e780a8f10 addr v2:172.21.15.173:3300/0 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9e78141920 addr v1:172.21.15.29:6789/0 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9e7813ea20 addr v1:172.21.15.173:6789/0 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e78141e40 con 0x7f9e78141920 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7813f560 con 0x7f9e7813ea20 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:56.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e780a92f0 con 0x7f9e780a8f10 2024-04-09T12:04:56.595 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:56.595 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7f5fb640 10 monclient(hunting): authenticate will time out at 1362.709442s 2024-04-09T12:04:56.595 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.590+0000 7f9e7cb96640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9e78141920 0x7f9e780b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38146/0 (socket says 172.21.15.29:38146) 2024-04-09T12:04:56.595 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.591+0000 7f9e7cb96640 1 -- 172.21.15.29:0/3644422422 learned_addr learned my addr 172.21.15.29:0/3644422422 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:04:56.595 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.591+0000 7f9e7d397640 1 --2- 172.21.15.29:0/3644422422 >> v2:172.21.15.173:3300/0 conn(0x7f9e780a8f10 0x7f9e781422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:56.595 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.592+0000 7f9e7d397640 10 monclient(hunting): get_auth_request con 0x7f9e780a8f10 auth_method 0 2024-04-09T12:04:56.595 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.592+0000 7f9e7d397640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:56.595 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.592+0000 7f9e7d397640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:56.595 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.592+0000 7f9e7d397640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:56.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.593+0000 7f9e7d397640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:56.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.593+0000 7f9e7d397640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:56.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.593+0000 7f9e7d397640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:56.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.593+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528521706 0 0) 0x7f9e78141e40 con 0x7f9e78141920 2024-04-09T12:04:56.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.593+0000 7f9e6ffff640 10 monclient(hunting): _negotiate 2024-04-09T12:04:56.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.593+0000 7f9e6ffff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:56.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.593+0000 7f9e6ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:56.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.593+0000 7f9e6ffff640 10 monclient(hunting): my global_id is 4194 2024-04-09T12:04:56.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.593+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e64003520 con 0x7f9e78141920 2024-04-09T12:04:56.599 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.596+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 541789665 0 0) 0x7f9e64003520 con 0x7f9e78141920 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.596+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 >> v2:172.21.15.173:3300/0 conn(0x7f9e780a8f10 msgr2=0x7f9e781422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.596+0000 7f9e6ffff640 1 --2- 172.21.15.29:0/3644422422 >> v2:172.21.15.173:3300/0 conn(0x7f9e780a8f10 0x7f9e781422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 >> v1:172.21.15.173:6789/0 conn(0x7f9e7813ea20 legacy=0x7f9e7813ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient: _finish_hunting 0 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 monclient: found mon.noname-a-legacy 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.29:6789/0 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e78142810 con 0x7f9e78141920 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient: _finish_auth 0 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient: _check_auth_tickets 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412254180 0 0) 0x7f9e68001670 con 0x7f9e78141920 2024-04-09T12:04:56.600 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient: dump: 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] but i'm connected to v1:172.21.15.29:6789/0, reconnecting 2024-04-09T12:04:56.601 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 >> v1:172.21.15.29:6789/0 conn(0x7f9e78141920 legacy=0x7f9e780b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 --2- 172.21.15.29:0/3644422422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e64003a50 0x7f9e64003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient(hunting): picked mon.a con 0x7f9e64003a50 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 --2- 172.21.15.29:0/3644422422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e640047c0 0x7f9e64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient(hunting): picked mon.b con 0x7f9e640047c0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 --2- 172.21.15.29:0/3644422422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e640052a0 0x7f9e6400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient(hunting): picked mon.c con 0x7f9e640052a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e780a92f0 con 0x7f9e64003a50 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6400c1f0 con 0x7f9e640047c0 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:56.602 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6400c3b0 con 0x7f9e640052a0 2024-04-09T12:04:56.603 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:56.603 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e6ffff640 10 monclient(hunting): _finish_auth 0 2024-04-09T12:04:56.603 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e7d397640 1 --2- 172.21.15.29:0/3644422422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e64003a50 0x7f9e64003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:56.603 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.597+0000 7f9e7db98640 1 --2- 172.21.15.29:0/3644422422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e640052a0 0x7f9e6400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:56.603 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.598+0000 7f9e7db98640 10 monclient(hunting): get_auth_request con 0x7f9e640052a0 auth_method 0 2024-04-09T12:04:56.603 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.598+0000 7f9e7db98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:56.603 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.598+0000 7f9e7db98640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:56.603 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.598+0000 7f9e7db98640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.598+0000 7f9e7db98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.598+0000 7f9e7db98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.598+0000 7f9e7db98640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.599+0000 7f9e7d397640 10 monclient(hunting): get_auth_request con 0x7f9e64003a50 auth_method 0 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.599+0000 7f9e7d397640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.599+0000 7f9e7d397640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.599+0000 7f9e7d397640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.600+0000 7f9e7d397640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.600+0000 7f9e7d397640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.600+0000 7f9e7d397640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 10 monclient(hunting): handle_auth_done global_id 4194 payload 293 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 1 -- 172.21.15.29:0/3644422422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e640047c0 msgr2=0x7f9e64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:56.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 1 --2- 172.21.15.29:0/3644422422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e640047c0 0x7f9e64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 1 -- 172.21.15.29:0/3644422422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e64003a50 msgr2=0x7f9e64003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 1 --2- 172.21.15.29:0/3644422422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e64003a50 0x7f9e64003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 10 monclient: _finish_hunting 0 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 1 monclient: found mon.c 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 1 -- 172.21.15.29:0/3644422422 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e78142810 con 0x7f9e640052a0 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 10 monclient: _finish_auth 0 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 10 monclient: _check_auth_tickets 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7db98640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.601+0000 7f9e7f5fb640 5 monclient: authenticate success, global_id 4194 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.602+0000 7f9e7f5fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.602+0000 7f9e7db98640 1 -- 172.21.15.29:0/3644422422 reap_dead start 2024-04-09T12:04:56.607 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.603+0000 7f9e7db98640 1 --2- 172.21.15.29:0/3644422422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e640052a0 0x7f9e6400b980 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e70001e20 tx=0x7f9e640057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7398cd789b545db server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:56.610 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70003b70 con 0x7f9e640052a0 2024-04-09T12:04:56.610 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e6ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:56.610 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e6ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:04:56.610 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e6ffff640 10 monclient: dump: 2024-04-09T12:04:56.610 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:56.610 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:56.610 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:56.610 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:56.610 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e70003cf0 con 0x7f9e640052a0 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e7f5fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e6ffff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e6ffff640 1 -- 172.21.15.29:0/3644422422 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70005310 con 0x7f9e640052a0 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e7f5fb640 10 monclient: get_monmap_and_config success 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e7f5fb640 4 set_mon_vals no callback set 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e6ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e6ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:04:56.611 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e6ffff640 10 monclient: dump: 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e7f5fb640 10 monclient: shutdown 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e7f5fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e7f5fb640 1 -- 172.21.15.29:0/3644422422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e640052a0 msgr2=0x7f9e6400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.607+0000 7f9e7f5fb640 1 --2- 172.21.15.29:0/3644422422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e640052a0 0x7f9e6400b980 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e70001e20 tx=0x7f9e640057f0 comp rx=0 tx=0).stop 2024-04-09T12:04:56.612 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.608+0000 7f9e7f5fb640 1 -- 172.21.15.29:0/3644422422 shutdown_connections 2024-04-09T12:04:56.613 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.608+0000 7f9e7f5fb640 1 --2- 172.21.15.29:0/3644422422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e640052a0 0x7f9e6400b980 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:56.613 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.608+0000 7f9e7f5fb640 1 -- 172.21.15.29:0/3644422422 >> 172.21.15.29:0/3644422422 conn(0x7f9e780b72d0 msgr2=0x7f9e780b76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:56.613 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.608+0000 7f9e7f5fb640 1 -- 172.21.15.29:0/3644422422 shutdown_connections 2024-04-09T12:04:56.613 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.608+0000 7f9e7f5fb640 1 -- 172.21.15.29:0/3644422422 wait complete. 2024-04-09T12:04:56.618 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.609+0000 7f9e7f5fb640 10 monclient: build_initial_monmap 2024-04-09T12:04:56.618 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.609+0000 7f9e7f5fb640 10 monclient: monmap: 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:last_changed 0.000000 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:created 0.000000 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.609+0000 7f9e7f5fb640 1 librados: starting msgr at 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.609+0000 7f9e7f5fb640 1 librados: starting objecter 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.609+0000 7f9e7f5fb640 1 Processor -- start 2024-04-09T12:04:56.619 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.609+0000 7f9e7f5fb640 1 -- start start 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.609+0000 7f9e7f5fb640 1 librados: setting wanted keys 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.609+0000 7f9e7f5fb640 1 librados: calling monclient init 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.609+0000 7f9e7f5fb640 10 monclient: init 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 10 monclient: _reopen_session rank -1 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e640052a0 0x7f9e781d99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 10 monclient(hunting): picked mon.noname-a con 0x7f9e640052a0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e781d9f20 0x7f9e780b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 10 monclient(hunting): picked mon.noname-b con 0x7f9e781d9f20 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e7813a030 0x7f9e780b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 10 monclient(hunting): picked mon.noname-c con 0x7f9e7813a030 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e781da590 con 0x7f9e640052a0 2024-04-09T12:04:56.620 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e780ab550 con 0x7f9e781d9f20 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e780ab830 con 0x7f9e7813a030 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 10 monclient(hunting): _renew_subs 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.610+0000 7f9e7f5fb640 10 monclient(hunting): authenticate will time out at 1362.729372s 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7db98640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e7813a030 0x7f9e780b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7cb96640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e781d9f20 0x7f9e780b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7d397640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e640052a0 0x7f9e781d99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7db98640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e7813a030 0x7f9e780b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:60172/0 (socket says 172.21.15.29:60172) 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7db98640 1 -- 172.21.15.29:0/4034912843 learned_addr learned my addr 172.21.15.29:0/4034912843 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7db98640 10 monclient(hunting): get_auth_request con 0x7f9e7813a030 auth_method 0 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7db98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7db98640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:56.621 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7db98640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7d397640 10 monclient(hunting): get_auth_request con 0x7f9e640052a0 auth_method 0 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7d397640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7d397640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7d397640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7cb96640 10 monclient(hunting): get_auth_request con 0x7f9e781d9f20 auth_method 0 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7cb96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7cb96640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7cb96640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7db98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7db98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7db98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7d397640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7d397640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:56.622 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.611+0000 7f9e7d397640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.612+0000 7f9e7cb96640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.612+0000 7f9e7cb96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.612+0000 7f9e7cb96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.614+0000 7f9e7db98640 10 monclient(hunting): handle_auth_done global_id 4190 payload 824 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.614+0000 7f9e7db98640 1 -- 172.21.15.29:0/4034912843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e781d9f20 msgr2=0x7f9e780b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.614+0000 7f9e7db98640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e781d9f20 0x7f9e780b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.614+0000 7f9e7db98640 1 -- 172.21.15.29:0/4034912843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e640052a0 msgr2=0x7f9e781d99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.614+0000 7f9e7db98640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e640052a0 0x7f9e781d99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.614+0000 7f9e7db98640 10 monclient: _finish_hunting 0 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.614+0000 7f9e7db98640 1 monclient: found mon.noname-c 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.614+0000 7f9e7db98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.614+0000 7f9e7db98640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:04:56.623 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.614+0000 7f9e7db98640 1 -- 172.21.15.29:0/4034912843 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e780b0d20 con 0x7f9e7813a030 2024-04-09T12:04:56.624 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.617+0000 7f9e7db98640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e7813a030 0x7f9e780b07e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9e7002c040 tx=0x7f9e700014a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.617+0000 7f9e6dffb640 10 client.?.objecter ms_handle_connect 0x7f9e7813a030 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.617+0000 7f9e6dffb640 10 client.?.objecter resend_mon_ops 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 1 -- 172.21.15.29:0/4034912843 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70006d50 con 0x7f9e7813a030 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 10 monclient: dump: 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:56.625 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 10 monclient: _finish_auth 0 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 10 monclient: _check_auth_tickets 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 1 -- 172.21.15.29:0/4034912843 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e70003b80 con 0x7f9e7813a030 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 1 -- 172.21.15.29:0/4034912843 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70007230 con 0x7f9e7813a030 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6dffb640 10 monclient: dump: 2024-04-09T12:04:56.626 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e6f7fe640 4 set_mon_vals no callback set 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e7f5fb640 5 monclient: authenticate success, global_id 4190 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e7f5fb640 10 monclient: _renew_subs 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e7f5fb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:56.627 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e7f5fb640 1 -- 172.21.15.29:0/4034912843 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e780b5700 con 0x7f9e7813a030 2024-04-09T12:04:56.628 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e7f5fb640 10 client.4190.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:04:56.628 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e7f5fb640 10 monclient: _renew_subs 2024-04-09T12:04:56.628 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e7f5fb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:56.628 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e7f5fb640 1 -- 172.21.15.29:0/4034912843 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e780b5b00 con 0x7f9e7813a030 2024-04-09T12:04:56.628 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.621+0000 7f9e7f5fb640 1 librados: init done 2024-04-09T12:04:56.628 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.622+0000 7f9e5b7fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:56.628 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.622+0000 7f9e5b7fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:56.628 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.622+0000 7f9e5b7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:56.628 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.622+0000 7f9e5b7fe640 1 -- 172.21.15.29:0/4034912843 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e54005040 con 0x7f9e7813a030 2024-04-09T12:04:56.649 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.647+0000 7f9e6dffb640 1 -- 172.21.15.29:0/4034912843 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f9e70007390 con 0x7f9e7813a030 2024-04-09T12:04:56.650 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.648+0000 7f9e6dffb640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f9e5c06c550 0x7f9e5c06ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:04:56.650 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.648+0000 7f9e7d397640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f9e5c06c550 0x7f9e5c06ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:04:56.650 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.648+0000 7f9e7d397640 10 monclient: get_auth_request con 0x7f9e5c06c550 auth_method 0 2024-04-09T12:04:56.651 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.649+0000 7f9e7d397640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f9e5c06c550 0x7f9e5c06ea10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009b40 tx=0x7f9e74009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:04:56.651 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.649+0000 7f9e6dffb640 10 client.4190.objecter ms_handle_connect 0x7f9e5c06c550 2024-04-09T12:04:56.652 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.650+0000 7f9e6dffb640 1 -- 172.21.15.29:0/4034912843 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9e7007ab60 con 0x7f9e7813a030 2024-04-09T12:04:56.653 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.650+0000 7f9e6dffb640 10 client.4190.objecter ms_dispatch 0x7f9e78000b90 osd_map(10..10 src has 1..10) v4 2024-04-09T12:04:56.653 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.650+0000 7f9e6dffb640 3 client.4190.objecter handle_osd_map got epochs [10,10] > 0 2024-04-09T12:04:56.653 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.650+0000 7f9e6dffb640 3 client.4190.objecter handle_osd_map decoding full epoch 10 2024-04-09T12:04:56.653 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.650+0000 7f9e6dffb640 20 client.4190.objecter dump_active .. 0 homeless 2024-04-09T12:04:56.937 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.935+0000 7f9e6dffb640 1 -- 172.21.15.29:0/4034912843 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f9e700767a0 con 0x7f9e7813a030 2024-04-09T12:04:56.937 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.935+0000 7f9e6dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:04:56.938 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:56.935+0000 7f9e6dffb640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:04:57.228 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.225+0000 7f9e5b7fe640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:57.228 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.225+0000 7f9e5b7fe640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:57.228 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.225+0000 7f9e5b7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:04:57.228 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.225+0000 7f9e5b7fe640 1 -- 172.21.15.29:0/4034912843 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e540055c0 con 0x7f9e7813a030 2024-04-09T12:04:57.352 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.349+0000 7f9e6dffb640 1 -- 172.21.15.29:0/4034912843 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9e70007db0 con 0x7f9e7813a030 2024-04-09T12:04:57.352 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.349+0000 7f9e6dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:04:57.352 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.349+0000 7f9e6dffb640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:04:57.352 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-09T12:04:57.352 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"1673ebad-34a7-414e-b498-c4f5250b317b","created":"2024-04-09T12:04:18.271948+0000","modified":"2024-04-09T12:04:23.695144+0000","last_up_change":"0.000000","last_in_change":"2024-04-09T12:04:23.695144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c929787-7de5-4d2f-9b36-3a165fa73386","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54d0b5c7-3415-4585-8a9b-c67a8ae94ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a343481-8465-4e19-989c-4a62c926338c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7f553202-73e9-496c-893f-185c61f66807","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84050623-d3f3-40ba-b63e-92d56a74bfd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"883e841f-8acc-4268-8e64-c556b10befa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"126085be-23ad-45b6-951d-47886bdfa75c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-09T12:04:57.354 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.352+0000 7f9e5b7fe640 10 librados: watch_flush enter 2024-04-09T12:04:57.354 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.352+0000 7f9e5b7fe640 10 librados: watch_flush exit 2024-04-09T12:04:57.354 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.352+0000 7f9e5b7fe640 20 client.4190.objecter shutdown clearing up homeless session... 2024-04-09T12:04:57.354 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.352+0000 7f9e5b7fe640 10 client.4190.objecter successfully canceled tick 2024-04-09T12:04:57.354 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.352+0000 7f9e5b7fe640 1 -- 172.21.15.29:0/4034912843 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f9e5c06c550 msgr2=0x7f9e5c06ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:57.355 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.352+0000 7f9e5b7fe640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f9e5c06c550 0x7f9e5c06ea10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009b40 tx=0x7f9e74009190 comp rx=0 tx=0).stop 2024-04-09T12:04:57.355 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.352+0000 7f9e5b7fe640 10 monclient: shutdown 2024-04-09T12:04:57.355 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.352+0000 7f9e5b7fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:04:57.355 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.352+0000 7f9e5b7fe640 1 -- 172.21.15.29:0/4034912843 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e7813a030 msgr2=0x7f9e780b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:04:57.355 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.352+0000 7f9e5b7fe640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e7813a030 0x7f9e780b07e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9e7002c040 tx=0x7f9e700014a0 comp rx=0 tx=0).stop 2024-04-09T12:04:57.355 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.353+0000 7f9e5b7fe640 1 -- 172.21.15.29:0/4034912843 shutdown_connections 2024-04-09T12:04:57.356 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.353+0000 7f9e5b7fe640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f9e5c06c550 0x7f9e5c06ea10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:57.356 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.353+0000 7f9e5b7fe640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e7813a030 0x7f9e780b07e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:57.356 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.353+0000 7f9e5b7fe640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e781d9f20 0x7f9e780b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:57.356 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.353+0000 7f9e5b7fe640 1 --2- 172.21.15.29:0/4034912843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e640052a0 0x7f9e781d99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:04:57.356 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.353+0000 7f9e5b7fe640 1 -- 172.21.15.29:0/4034912843 >> 172.21.15.29:0/4034912843 conn(0x7f9e780b72d0 msgr2=0x7f9e78068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:04:57.356 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.353+0000 7f9e5b7fe640 1 -- 172.21.15.29:0/4034912843 shutdown_connections 2024-04-09T12:04:57.356 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.353+0000 7f9e5b7fe640 1 -- 172.21.15.29:0/4034912843 wait complete. 2024-04-09T12:04:57.356 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:04:57.353+0000 7f9e5b7fe640 1 librados: shutdown 2024-04-09T12:04:57.368 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-09T12:04:58.586 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:04:58.581+0000 5dc2480 -1 osd.5 0 log_to_monitors true 2024-04-09T12:04:58.945 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:04:58.940+0000 5dc2480 -1 osd.6 0 log_to_monitors true 2024-04-09T12:04:59.069 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:04:59.064+0000 5dc2480 -1 osd.7 0 log_to_monitors true 2024-04-09T12:04:59.887 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:04:59.882+0000 5dc2480 -1 osd.4 0 log_to_monitors true 2024-04-09T12:04:59.921 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:04:59.915+0000 5dc2480 -1 osd.0 0 log_to_monitors true 2024-04-09T12:05:00.469 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:05:00.462+0000 5dc2480 -1 osd.2 0 log_to_monitors true 2024-04-09T12:05:00.873 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:05:00.869+0000 5dc2480 -1 osd.3 0 log_to_monitors true 2024-04-09T12:05:01.404 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:01.399+0000 5dc2480 -1 osd.1 0 log_to_monitors true 2024-04-09T12:05:01.983 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:05:01.978+0000 ae7c640 -1 osd.6 0 waiting for initial osdmap 2024-04-09T12:05:02.009 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:05:01.998+0000 c695640 -1 osd.5 0 waiting for initial osdmap 2024-04-09T12:05:02.401 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:05:02.386+0000 1045a640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-09T12:05:02.420 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:05:02.406+0000 1045a640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-09T12:05:03.195 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:05:03.189+0000 c695640 -1 osd.0 0 waiting for initial osdmap 2024-04-09T12:05:03.617 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:05:03.602+0000 1045a640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-09T12:05:04.175 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-09T12:05:04.233 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:05:04.227+0000 ae7c640 -1 osd.2 0 waiting for initial osdmap 2024-04-09T12:05:04.257 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:05:04.249+0000 c695640 -1 osd.3 0 waiting for initial osdmap 2024-04-09T12:05:04.293 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.291+0000 7f3c9291f640 10 monclient: get_monmap_and_config 2024-04-09T12:05:04.294 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.291+0000 7f3c9291f640 10 monclient: build_initial_monmap 2024-04-09T12:05:04.294 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.291+0000 7f3c9291f640 10 monclient: monmap: 2024-04-09T12:05:04.294 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:05:04.294 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:04.294 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:05:04.292343+0000 2024-04-09T12:05:04.294 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:05:04.292343+0000 2024-04-09T12:05:04.294 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:04.294 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:04.295 INFO:teuthology.misc.health.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:04.295 INFO:teuthology.misc.health.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:04.295 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:04.295 INFO:teuthology.misc.health.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:04.295 INFO:teuthology.misc.health.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:04.295 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:04.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.292+0000 7f3c9291f640 1 Processor -- start 2024-04-09T12:05:04.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.292+0000 7f3c9291f640 1 -- start start 2024-04-09T12:05:04.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.292+0000 7f3c9291f640 10 monclient: init 2024-04-09T12:05:04.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:04.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2024-04-09T12:05:04.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3c8c0a8f10 0x7f3c8c1422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:04.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 10 monclient(hunting): picked mon.noname-c con 0x7f3c8c0a8f10 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3c8c141920 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c8c13ea20 0x7f3c8c13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 10 monclient(hunting): picked mon.noname-b con 0x7f3c8c13ea20 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c141e40 con 0x7f3c8c141920 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c0a92f0 con 0x7f3c8c0a8f10 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c142810 con 0x7f3c8c13ea20 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.293+0000 7f3c9291f640 10 monclient(hunting): authenticate will time out at 1370.412456s 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c8bfff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3c8c0a8f10 0x7f3c8c1422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:04.298 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c90ebc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c8c13ea20 0x7f3c8c13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c8bfff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3c8c0a8f10 0x7f3c8c1422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:59162/0 (socket says 172.21.15.29:59162) 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c8bfff640 1 -- 172.21.15.29:0/2466051217 learned_addr learned my addr 172.21.15.29:0/2466051217 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c8bfff640 10 monclient(hunting): get_auth_request con 0x7f3c8c0a8f10 auth_method 0 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c8bfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c8bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c90ebc640 10 monclient(hunting): get_auth_request con 0x7f3c8c13ea20 auth_method 0 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c90ebc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c90ebc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.294+0000 7f3c90ebc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.295+0000 7f3c8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.295+0000 7f3c8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.295+0000 7f3c8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:04.299 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.295+0000 7f3c90ebc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:04.300 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.295+0000 7f3c90ebc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:04.300 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.295+0000 7f3c90ebc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:04.301 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.297+0000 7f3c90ebc640 10 monclient(hunting): handle_auth_done global_id 4211 payload 274 2024-04-09T12:05:04.301 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.297+0000 7f3c90ebc640 1 -- 172.21.15.29:0/2466051217 >> v2:172.21.15.173:3300/0 conn(0x7f3c8c0a8f10 msgr2=0x7f3c8c1422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:04.301 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.297+0000 7f3c90ebc640 1 --2- 172.21.15.29:0/2466051217 >> v2:172.21.15.173:3300/0 conn(0x7f3c8c0a8f10 0x7f3c8c1422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:04.301 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.297+0000 7f3c90ebc640 1 -- 172.21.15.29:0/2466051217 >> v1:172.21.15.173:6789/0 conn(0x7f3c8c141920 legacy=0x7f3c8c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:04.301 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.297+0000 7f3c90ebc640 10 monclient: _finish_hunting 0 2024-04-09T12:05:04.301 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.297+0000 7f3c90ebc640 1 monclient: found mon.noname-b 2024-04-09T12:05:04.301 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.297+0000 7f3c90ebc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:04.301 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.297+0000 7f3c90ebc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:04.302 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.297+0000 7f3c90ebc640 1 -- 172.21.15.29:0/2466051217 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0aa640 con 0x7f3c8c13ea20 2024-04-09T12:05:04.302 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.298+0000 7f3c90ebc640 1 --2- 172.21.15.29:0/2466051217 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c8c13ea20 0x7f3c8c13ee90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009d90 tx=0x7f3c8402bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33151b0090ebc757 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:04.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 1 -- 172.21.15.29:0/2466051217 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8402caa0 con 0x7f3c8c13ea20 2024-04-09T12:05:04.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:04.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:04.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 10 monclient: dump: 2024-04-09T12:05:04.304 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:04.304 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 10 monclient: _finish_auth 0 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 1 -- 172.21.15.29:0/2466051217 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8402cc00 con 0x7f3c8c13ea20 2024-04-09T12:05:04.305 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 1 -- 172.21.15.29:0/2466051217 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84034440 con 0x7f3c8c13ea20 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c9291f640 5 monclient: authenticate success, global_id 4211 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c9291f640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c9291f640 4 set_mon_vals no callback set 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.302+0000 7f3c8affd640 10 monclient: dump: 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:04.306 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:04.307 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:04.307 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:04.307 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:04.307 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:04.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.303+0000 7f3c9291f640 10 monclient: shutdown 2024-04-09T12:05:04.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.303+0000 7f3c9291f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:04.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.303+0000 7f3c9291f640 1 -- 172.21.15.29:0/2466051217 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c8c13ea20 msgr2=0x7f3c8c13ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:04.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.303+0000 7f3c9291f640 1 --2- 172.21.15.29:0/2466051217 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c8c13ea20 0x7f3c8c13ee90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009d90 tx=0x7f3c8402bcf0 comp rx=0 tx=0).stop 2024-04-09T12:05:04.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.303+0000 7f3c9291f640 1 -- 172.21.15.29:0/2466051217 shutdown_connections 2024-04-09T12:05:04.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.303+0000 7f3c9291f640 1 --2- 172.21.15.29:0/2466051217 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c8c13ea20 0x7f3c8c13ee90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:04.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.303+0000 7f3c9291f640 1 --2- 172.21.15.29:0/2466051217 >> v2:172.21.15.173:3300/0 conn(0x7f3c8c0a8f10 0x7f3c8c1422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:04.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.303+0000 7f3c9291f640 1 -- 172.21.15.29:0/2466051217 >> 172.21.15.29:0/2466051217 conn(0x7f3c8c0b72d0 msgr2=0x7f3c8c0b76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.303+0000 7f3c9291f640 1 -- 172.21.15.29:0/2466051217 shutdown_connections 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.303+0000 7f3c9291f640 1 -- 172.21.15.29:0/2466051217 wait complete. 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.304+0000 7f3c9291f640 10 monclient: build_initial_monmap 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.304+0000 7f3c9291f640 10 monclient: monmap: 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:created 0.000000 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:04.313 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.305+0000 7f3c9291f640 1 librados: starting msgr at 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.305+0000 7f3c9291f640 1 librados: starting objecter 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.305+0000 7f3c9291f640 1 Processor -- start 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.305+0000 7f3c9291f640 1 -- start start 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.305+0000 7f3c9291f640 1 librados: setting wanted keys 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.305+0000 7f3c9291f640 1 librados: calling monclient init 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.305+0000 7f3c9291f640 10 monclient: init 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.306+0000 7f3c9291f640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.306+0000 7f3c9291f640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.306+0000 7f3c9291f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c8c0a8f10 0x7f3c8c1da2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.306+0000 7f3c9291f640 10 monclient(hunting): picked mon.noname-a con 0x7f3c8c0a8f10 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:04.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c8c13ea20 0x7f3c8c1382d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 10 monclient(hunting): picked mon.noname-c con 0x7f3c8c13ea20 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c8c1da830 0x7f3c8c138810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 10 monclient(hunting): picked mon.noname-b con 0x7f3c8c1da830 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c138d50 con 0x7f3c8c0a8f10 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c1d9bc0 con 0x7f3c8c1da830 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c1d9e60 con 0x7f3c8c13ea20 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.307+0000 7f3c9291f640 10 monclient(hunting): authenticate will time out at 1370.426962s 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c8c13ea20 0x7f3c8c1382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:04.315 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c90ebc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c8c1da830 0x7f3c8c138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c8c0a8f10 0x7f3c8c1da2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c8c0a8f10 0x7f3c8c1da2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43968/0 (socket says 172.21.15.29:43968) 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8b7fe640 10 monclient(hunting): get_auth_request con 0x7f3c8c13ea20 auth_method 0 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8bfff640 1 -- 172.21.15.29:0/2274357547 learned_addr learned my addr 172.21.15.29:0/2274357547 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8bfff640 10 monclient(hunting): get_auth_request con 0x7f3c8c0a8f10 auth_method 0 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8bfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c8bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c90ebc640 10 monclient(hunting): get_auth_request con 0x7f3c8c1da830 auth_method 0 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c90ebc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:04.316 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c90ebc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:04.317 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.308+0000 7f3c90ebc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:04.317 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.309+0000 7f3c8b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:04.317 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.309+0000 7f3c8b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:04.317 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.309+0000 7f3c8b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:04.317 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.309+0000 7f3c90ebc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:04.317 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.309+0000 7f3c90ebc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:04.317 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.309+0000 7f3c90ebc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:04.317 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.310+0000 7f3c8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:04.317 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.310+0000 7f3c8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:04.317 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.310+0000 7f3c8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.311+0000 7f3c90ebc640 10 monclient(hunting): handle_auth_done global_id 4276 payload 824 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.312+0000 7f3c90ebc640 1 -- 172.21.15.29:0/2274357547 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c8c13ea20 msgr2=0x7f3c8c1382d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.312+0000 7f3c90ebc640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c8c13ea20 0x7f3c8c1382d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.312+0000 7f3c90ebc640 1 -- 172.21.15.29:0/2274357547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c8c0a8f10 msgr2=0x7f3c8c1da2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.312+0000 7f3c90ebc640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c8c0a8f10 0x7f3c8c1da2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.312+0000 7f3c90ebc640 10 monclient: _finish_hunting 0 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.312+0000 7f3c90ebc640 1 monclient: found mon.noname-b 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.312+0000 7f3c90ebc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.312+0000 7f3c90ebc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.312+0000 7f3c90ebc640 1 -- 172.21.15.29:0/2274357547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c84009a70 con 0x7f3c8c1da830 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.314+0000 7f3c90ebc640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c8c1da830 0x7f3c8c138810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c073f10 tx=0x7f3c84004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:04.319 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.314+0000 7f3c88ff9640 10 client.?.objecter ms_handle_connect 0x7f3c8c1da830 2024-04-09T12:05:04.320 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.314+0000 7f3c88ff9640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:04.322 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 1 -- 172.21.15.29:0/2274357547 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8403e610 con 0x7f3c8c1da830 2024-04-09T12:05:04.322 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:04.322 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:04.322 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 10 monclient: dump: 2024-04-09T12:05:04.322 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:04.322 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:04.322 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:04.322 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:04.322 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:04.322 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 10 monclient: _finish_auth 0 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 10 monclient: _check_auth_tickets 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 1 -- 172.21.15.29:0/2274357547 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8403e770 con 0x7f3c8c1da830 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 1 -- 172.21.15.29:0/2274357547 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8403eb20 con 0x7f3c8c1da830 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c9291f640 5 monclient: authenticate success, global_id 4276 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c88ff9640 10 monclient: dump: 2024-04-09T12:05:04.323 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c9291f640 10 monclient: _renew_subs 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c9291f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c9291f640 1 -- 172.21.15.29:0/2274357547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c0b69a0 con 0x7f3c8c1da830 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c9291f640 10 client.4276.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c9291f640 10 monclient: _renew_subs 2024-04-09T12:05:04.324 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c9291f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:04.325 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c9291f640 1 -- 172.21.15.29:0/2274357547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c0b4fd0 con 0x7f3c8c1da830 2024-04-09T12:05:04.325 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c9291f640 1 librados: init done 2024-04-09T12:05:04.325 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.318+0000 7f3c8a7fc640 4 set_mon_vals no callback set 2024-04-09T12:05:04.325 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.319+0000 7f3c9291f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:04.325 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.319+0000 7f3c9291f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:04.325 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.319+0000 7f3c9291f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:04.325 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.319+0000 7f3c9291f640 1 -- 172.21.15.29:0/2274357547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c04e160 con 0x7f3c8c1da830 2024-04-09T12:05:04.593 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.591+0000 7f3c88ff9640 1 -- 172.21.15.29:0/2274357547 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f3c8403b050 con 0x7f3c8c1da830 2024-04-09T12:05:04.593 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.591+0000 7f3c88ff9640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3c7806c500 0x7f3c7806e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:04.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.591+0000 7f3c8bfff640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3c7806c500 0x7f3c7806e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:04.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.591+0000 7f3c8bfff640 10 monclient: get_auth_request con 0x7f3c7806c500 auth_method 0 2024-04-09T12:05:04.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.592+0000 7f3c88ff9640 10 client.4276.objecter ms_handle_connect 0x7f3c7806c500 2024-04-09T12:05:04.594 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.592+0000 7f3c8bfff640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3c7806c500 0x7f3c7806e9c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0094a0 tx=0x7f3c7c009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:04.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.594+0000 7f3c88ff9640 1 -- 172.21.15.29:0/2274357547 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3071+0+0 (secure 0 0 0) 0x7f3c8407af70 con 0x7f3c8c1da830 2024-04-09T12:05:04.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.594+0000 7f3c88ff9640 10 client.4276.objecter ms_dispatch 0x7f3c8c000b90 osd_map(14..14 src has 1..14) v4 2024-04-09T12:05:04.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.594+0000 7f3c88ff9640 3 client.4276.objecter handle_osd_map got epochs [14,14] > 0 2024-04-09T12:05:04.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.594+0000 7f3c88ff9640 3 client.4276.objecter handle_osd_map decoding full epoch 14 2024-04-09T12:05:04.596 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.594+0000 7f3c88ff9640 20 client.4276.objecter dump_active .. 0 homeless 2024-04-09T12:05:04.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.604+0000 7f3c88ff9640 1 -- 172.21.15.29:0/2274357547 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f3c840772b0 con 0x7f3c8c1da830 2024-04-09T12:05:04.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.604+0000 7f3c88ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:04.606 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.604+0000 7f3c88ff9640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:04.714 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:05:04.695+0000 1045a640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-09T12:05:04.771 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:05:04.756+0000 1045a640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-09T12:05:04.796 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.794+0000 7f3c9291f640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:04.796 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.794+0000 7f3c9291f640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:04.796 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.794+0000 7f3c9291f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:04.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.794+0000 7f3c9291f640 1 -- 172.21.15.29:0/2274357547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c8c1d9fa0 con 0x7f3c8c1da830 2024-04-09T12:05:04.826 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.824+0000 7f3c88ff9640 1 -- 172.21.15.29:0/2274357547 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8392 (secure 0 0 0) 0x7f3c8404e090 con 0x7f3c8c1da830 2024-04-09T12:05:04.826 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.824+0000 7f3c88ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:04.826 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.824+0000 7f3c88ff9640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:04.826 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-09T12:05:04.827 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":14,"fsid":"1673ebad-34a7-414e-b498-c4f5250b317b","created":"2024-04-09T12:04:18.271948+0000","modified":"2024-04-09T12:05:03.846778+0000","last_up_change":"2024-04-09T12:05:03.846778+0000","last_in_change":"2024-04-09T12:04:23.695144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c929787-7de5-4d2f-9b36-3a165fa73386","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":35238},{"type":"v1","addr":"172.21.15.29:6809","nonce":35238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":35238},{"type":"v1","addr":"172.21.15.29:6811","nonce":35238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":35238},{"type":"v1","addr":"172.21.15.29:6815","nonce":35238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":35238},{"type":"v1","addr":"172.21.15.29:6813","nonce":35238}]},"public_addr":"172.21.15.29:6809/35238","cluster_addr":"172.21.15.29:6811/35238","heartbeat_back_addr":"172.21.15.29:6815/35238","heartbeat_front_addr":"172.21.15.29:6813/35238","state":["exists","up"]},{"osd":1,"uuid":"54d0b5c7-3415-4585-8a9b-c67a8ae94ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a343481-8465-4e19-989c-4a62c926338c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7f553202-73e9-496c-893f-185c61f66807","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84050623-d3f3-40ba-b63e-92d56a74bfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":35531},{"type":"v1","addr":"172.21.15.173:6826","nonce":35531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":35531},{"type":"v1","addr":"172.21.15.173:6829","nonce":35531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":35531},{"type":"v1","addr":"172.21.15.173:6833","nonce":35531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":35531},{"type":"v1","addr":"172.21.15.173:6831","nonce":35531}]},"public_addr":"172.21.15.173:6826/35531","cluster_addr":"172.21.15.173:6829/35531","heartbeat_back_addr":"172.21.15.173:6833/35531","heartbeat_front_addr":"172.21.15.173:6831/35531","state":["exists","up"]},{"osd":6,"uuid":"883e841f-8acc-4268-8e64-c556b10befa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":35530},{"type":"v1","addr":"172.21.15.173:6803","nonce":35530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":35530},{"type":"v1","addr":"172.21.15.173:6805","nonce":35530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":35530},{"type":"v1","addr":"172.21.15.173:6809","nonce":35530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":35530},{"type":"v1","addr":"172.21.15.173:6807","nonce":35530}]},"public_addr":"172.21.15.173:6803/35530","cluster_addr":"172.21.15.173:6805/35530","heartbeat_back_addr":"172.21.15.173:6809/35530","heartbeat_front_addr":"172.21.15.173:6807/35530","state":["exists","up"]},{"osd":7,"uuid":"126085be-23ad-45b6-951d-47886bdfa75c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:00.598310+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:00.974235+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-09T12:05:04.829 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.826+0000 7f3c9291f640 10 librados: watch_flush enter 2024-04-09T12:05:04.829 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.826+0000 7f3c9291f640 10 librados: watch_flush exit 2024-04-09T12:05:04.829 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.826+0000 7f3c9291f640 20 client.4276.objecter shutdown clearing up homeless session... 2024-04-09T12:05:04.829 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.826+0000 7f3c9291f640 10 client.4276.objecter successfully canceled tick 2024-04-09T12:05:04.829 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 1 -- 172.21.15.29:0/2274357547 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3c7806c500 msgr2=0x7f3c7806e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:04.829 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3c7806c500 0x7f3c7806e9c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0094a0 tx=0x7f3c7c009240 comp rx=0 tx=0).stop 2024-04-09T12:05:04.829 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 10 monclient: shutdown 2024-04-09T12:05:04.829 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:04.829 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 1 -- 172.21.15.29:0/2274357547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c8c1da830 msgr2=0x7f3c8c138810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:04.829 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c8c1da830 0x7f3c8c138810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c073f10 tx=0x7f3c84004a40 comp rx=0 tx=0).stop 2024-04-09T12:05:04.829 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 1 -- 172.21.15.29:0/2274357547 shutdown_connections 2024-04-09T12:05:04.830 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3c7806c500 0x7f3c7806e9c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:04.830 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c8c1da830 0x7f3c8c138810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:04.830 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c8c13ea20 0x7f3c8c1382d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:04.830 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 1 --2- 172.21.15.29:0/2274357547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c8c0a8f10 0x7f3c8c1da2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:04.830 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.827+0000 7f3c9291f640 1 -- 172.21.15.29:0/2274357547 >> 172.21.15.29:0/2274357547 conn(0x7f3c8c0b72d0 msgr2=0x7f3c8c13a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:04.830 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.828+0000 7f3c9291f640 1 -- 172.21.15.29:0/2274357547 shutdown_connections 2024-04-09T12:05:04.831 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.828+0000 7f3c9291f640 1 -- 172.21.15.29:0/2274357547 wait complete. 2024-04-09T12:05:04.831 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:04.828+0000 7f3c9291f640 1 librados: shutdown 2024-04-09T12:05:04.842 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-04-09T12:05:09.149 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:05:09.079+0000 5dc2480 -1 bdev(0x1909d1a0 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2024-04-09T12:05:09.207 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:05:09.189+0000 5dc2480 -1 bdev(0x1909d1a0 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2024-04-09T12:05:09.722 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:05:09.206+0000 5dc2480 -1 bdev(0x1909d1a0 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2024-04-09T12:05:09.739 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:05:09.265+0000 5dc2480 -1 bdev(0x1909d1a0 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2024-04-09T12:05:09.742 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:05:09.284+0000 5dc2480 -1 bdev(0x1909d1a0 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2024-04-09T12:05:09.872 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:05:09.719+0000 5dc2480 -1 bdev(0x1909d1a0 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2024-04-09T12:05:09.993 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:05:09.737+0000 5dc2480 -1 bdev(0x1909d1a0 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2024-04-09T12:05:10.246 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:10.232+0000 5dc2480 -1 bdev(0x19353a10 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-09T12:05:10.571 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:10.258+0000 5dc2480 -1 bdev(0x19353a10 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-09T12:05:10.587 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:10.569+0000 5dc2480 -1 bdev(0x19353a10 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 2 2024-04-09T12:05:10.757 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:10.658+0000 5dc2480 -1 bdev(0x19353a10 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 4 2024-04-09T12:05:10.757 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:10.742+0000 5dc2480 -1 bdev(0x19353a10 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-09T12:05:10.823 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:10.755+0000 5dc2480 -1 bdev(0x19353a10 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-09T12:05:10.823 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:05:10.818+0000 ae7c640 -1 osd.7 0 waiting for initial osdmap 2024-04-09T12:05:10.833 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:10.821+0000 5dc2480 -1 bdev(0x19353a10 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-09T12:05:11.136 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:10.832+0000 5dc2480 -1 bdev(0x19353a10 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-09T12:05:11.213 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:10.848+0000 5dc2480 -1 bdev(0x19353a10 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-09T12:05:11.213 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:11.031+0000 5dc2480 -1 bdev(0x19353a10 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 2 2024-04-09T12:05:11.213 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:11.060+0000 5dc2480 -1 bdev(0x19353a10 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-09T12:05:11.307 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:05:11.290+0000 14462640 -1 osd.7 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-09T12:05:11.648 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-09T12:05:11.738 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.736+0000 7f21f2c0c640 10 monclient: get_monmap_and_config 2024-04-09T12:05:11.738 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.736+0000 7f21f2c0c640 10 monclient: build_initial_monmap 2024-04-09T12:05:11.738 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.736+0000 7f21f2c0c640 10 monclient: monmap: 2024-04-09T12:05:11.738 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:05:11.736563+0000 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:05:11.736563+0000 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.736+0000 7f21f2c0c640 1 Processor -- start 2024-04-09T12:05:11.739 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.736+0000 7f21f2c0c640 1 -- start start 2024-04-09T12:05:11.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.736+0000 7f21f2c0c640 10 monclient: init 2024-04-09T12:05:11.742 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:11.742 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2024-04-09T12:05:11.742 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f21ec0b7c80 0x7f21ec0a9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:11.742 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 10 monclient(hunting): picked mon.noname-a con 0x7f21ec0b7c80 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:11.742 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec0b1040 0x7f21ec1418c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:11.742 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 10 monclient(hunting): picked mon.noname-b con 0x7f21ec0b1040 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:11.742 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f21ec13eb00 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:11.742 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ec0aa3d0 con 0x7f21ec13eb00 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ec0a8f10 con 0x7f21ec0b7c80 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec0b8060 con 0x7f21ec0b1040 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.737+0000 7f21f2c0c640 10 monclient(hunting): authenticate will time out at 1377.856473s 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21ebfff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec0b1040 0x7f21ec1418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21f09a8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f21ec0b7c80 0x7f21ec0a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21ebfff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec0b1040 0x7f21ec1418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:42778/0 (socket says 172.21.15.29:42778) 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21ebfff640 1 -- 172.21.15.29:0/1675968237 learned_addr learned my addr 172.21.15.29:0/1675968237 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21ebfff640 10 monclient(hunting): get_auth_request con 0x7f21ec0b1040 auth_method 0 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:11.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21ebfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21f09a8640 10 monclient(hunting): get_auth_request con 0x7f21ec0b7c80 auth_method 0 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21f09a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21f09a8640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.738+0000 7f21f09a8640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.739+0000 7f21f09a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.739+0000 7f21f09a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.739+0000 7f21f09a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.740+0000 7f21ebfff640 10 monclient(hunting): handle_auth_done global_id 4223 payload 274 2024-04-09T12:05:11.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.740+0000 7f21ebfff640 1 -- 172.21.15.29:0/1675968237 >> v2:172.21.15.29:3300/0 conn(0x7f21ec0b7c80 msgr2=0x7f21ec0a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:11.745 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.740+0000 7f21ebfff640 1 --2- 172.21.15.29:0/1675968237 >> v2:172.21.15.29:3300/0 conn(0x7f21ec0b7c80 0x7f21ec0a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:11.745 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.740+0000 7f21ebfff640 1 -- 172.21.15.29:0/1675968237 >> v1:172.21.15.29:6789/0 conn(0x7f21ec13eb00 legacy=0x7f21ec13ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:11.745 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.740+0000 7f21ebfff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:11.745 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.740+0000 7f21ebfff640 1 monclient: found mon.noname-b 2024-04-09T12:05:11.745 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.740+0000 7f21ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:11.745 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.740+0000 7f21ebfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:11.745 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.740+0000 7f21ebfff640 1 -- 172.21.15.29:0/1675968237 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec0aa920 con 0x7f21ec0b1040 2024-04-09T12:05:11.745 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.742+0000 7f21ebfff640 1 --2- 172.21.15.29:0/1675968237 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec0b1040 0x7f21ec1418c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009870 tx=0x7f21d802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1ba2cea44d0943 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:11.749 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 1 -- 172.21.15.29:0/1675968237 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8030840 con 0x7f21ec0b1040 2024-04-09T12:05:11.749 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:11.749 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:11.749 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 10 monclient: dump: 2024-04-09T12:05:11.749 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:11.749 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:11.749 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:11.749 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:11.749 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:11.749 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 10 monclient: _finish_auth 0 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 10 monclient: _check_auth_tickets 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 1 -- 172.21.15.29:0/1675968237 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d80309a0 con 0x7f21ec0b1040 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21f2c0c640 5 monclient: authenticate success, global_id 4223 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21f2c0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 1 -- 172.21.15.29:0/1675968237 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8030d30 con 0x7f21ec0b1040 2024-04-09T12:05:11.750 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21eb7fe640 10 monclient: dump: 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:11.751 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21f2c0c640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.746+0000 7f21f2c0c640 4 set_mon_vals no callback set 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.747+0000 7f21f2c0c640 10 monclient: shutdown 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.747+0000 7f21f2c0c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.747+0000 7f21f2c0c640 1 -- 172.21.15.29:0/1675968237 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec0b1040 msgr2=0x7f21ec1418c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.747+0000 7f21f2c0c640 1 --2- 172.21.15.29:0/1675968237 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec0b1040 0x7f21ec1418c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009870 tx=0x7f21d802b980 comp rx=0 tx=0).stop 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.747+0000 7f21f2c0c640 1 -- 172.21.15.29:0/1675968237 shutdown_connections 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.747+0000 7f21f2c0c640 1 --2- 172.21.15.29:0/1675968237 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec0b1040 0x7f21ec1418c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.747+0000 7f21f2c0c640 1 --2- 172.21.15.29:0/1675968237 >> v2:172.21.15.29:3300/0 conn(0x7f21ec0b7c80 0x7f21ec0a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.747+0000 7f21f2c0c640 1 -- 172.21.15.29:0/1675968237 >> 172.21.15.29:0/1675968237 conn(0x7f21ec071b70 msgr2=0x7f21ec0b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.747+0000 7f21f2c0c640 1 -- 172.21.15.29:0/1675968237 shutdown_connections 2024-04-09T12:05:11.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.747+0000 7f21f2c0c640 1 -- 172.21.15.29:0/1675968237 wait complete. 2024-04-09T12:05:11.755 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.748+0000 7f21f2c0c640 10 monclient: build_initial_monmap 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.748+0000 7f21f2c0c640 10 monclient: monmap: 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:created 0.000000 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.748+0000 7f21f2c0c640 1 librados: starting msgr at 2024-04-09T12:05:11.756 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.748+0000 7f21f2c0c640 1 librados: starting objecter 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.748+0000 7f21f2c0c640 1 Processor -- start 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.748+0000 7f21f2c0c640 1 -- start start 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.748+0000 7f21f2c0c640 1 librados: setting wanted keys 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.748+0000 7f21f2c0c640 1 librados: calling monclient init 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.748+0000 7f21f2c0c640 10 monclient: init 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21ec0b1040 0x7f21ec13bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 10 monclient(hunting): picked mon.noname-b con 0x7f21ec0b1040 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21ec0b7c80 0x7f21ec139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 10 monclient(hunting): picked mon.noname-a con 0x7f21ec0b7c80 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec13eb00 0x7f21ec1323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:11.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 10 monclient(hunting): picked mon.noname-c con 0x7f21ec13eb00 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec13b7a0 con 0x7f21ec0b7c80 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec13a330 con 0x7f21ec0b1040 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec138480 con 0x7f21ec13eb00 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f2c0c640 10 monclient(hunting): authenticate will time out at 1377.868378s 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21f11a9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec13eb00 0x7f21ec1323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.749+0000 7f21ebfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21ec0b7c80 0x7f21ec139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f09a8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21ec0b1040 0x7f21ec13bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:11.758 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f11a9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec13eb00 0x7f21ec1323d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:42792/0 (socket says 172.21.15.29:42792) 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f11a9640 1 -- 172.21.15.29:0/276063962 learned_addr learned my addr 172.21.15.29:0/276063962 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f11a9640 10 monclient(hunting): get_auth_request con 0x7f21ec13eb00 auth_method 0 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f11a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f11a9640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f11a9640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21ebfff640 10 monclient(hunting): get_auth_request con 0x7f21ec0b7c80 auth_method 0 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21ebfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f09a8640 10 monclient(hunting): get_auth_request con 0x7f21ec0b1040 auth_method 0 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f09a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f09a8640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:11.759 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f09a8640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f11a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f11a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21f11a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.750+0000 7f21ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.751+0000 7f21f09a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.751+0000 7f21f09a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.751+0000 7f21f09a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.753+0000 7f21f11a9640 10 monclient(hunting): handle_auth_done global_id 4226 payload 824 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.753+0000 7f21f11a9640 1 -- 172.21.15.29:0/276063962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21ec0b1040 msgr2=0x7f21ec13bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.753+0000 7f21f11a9640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21ec0b1040 0x7f21ec13bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.753+0000 7f21f11a9640 1 -- 172.21.15.29:0/276063962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21ec0b7c80 msgr2=0x7f21ec139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:11.760 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.753+0000 7f21f11a9640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21ec0b7c80 0x7f21ec139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:11.761 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.753+0000 7f21f11a9640 10 monclient: _finish_hunting 0 2024-04-09T12:05:11.761 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.753+0000 7f21f11a9640 1 monclient: found mon.noname-c 2024-04-09T12:05:11.761 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.753+0000 7f21f11a9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:11.761 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.753+0000 7f21f11a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:05:11.761 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.753+0000 7f21f11a9640 1 -- 172.21.15.29:0/276063962 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d80094d0 con 0x7f21ec13eb00 2024-04-09T12:05:11.762 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.756+0000 7f21f11a9640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec13eb00 0x7f21ec1323d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c7a0 tx=0x7f21e400cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:11.762 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.756+0000 7f21e97fa640 10 client.?.objecter ms_handle_connect 0x7f21ec13eb00 2024-04-09T12:05:11.762 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.756+0000 7f21e97fa640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:11.762 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 1 -- 172.21.15.29:0/276063962 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4003b70 con 0x7f21ec13eb00 2024-04-09T12:05:11.762 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:11.762 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 10 monclient: dump: 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 10 monclient: _finish_auth 0 2024-04-09T12:05:11.763 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 10 monclient: _check_auth_tickets 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21f2c0c640 5 monclient: authenticate success, global_id 4226 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 1 -- 172.21.15.29:0/276063962 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e4003cf0 con 0x7f21ec13eb00 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 1 -- 172.21.15.29:0/276063962 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4003ea0 con 0x7f21ec13eb00 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21e97fa640 10 monclient: dump: 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:11.764 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21f2c0c640 10 monclient: _renew_subs 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21f2c0c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.760+0000 7f21f2c0c640 1 -- 172.21.15.29:0/276063962 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec13a030 con 0x7f21ec13eb00 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.759+0000 7f21eaffd640 4 set_mon_vals no callback set 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.760+0000 7f21f2c0c640 10 client.4226.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.760+0000 7f21f2c0c640 10 monclient: _renew_subs 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.760+0000 7f21f2c0c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:11.765 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.760+0000 7f21f2c0c640 1 -- 172.21.15.29:0/276063962 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ec132af0 con 0x7f21ec13eb00 2024-04-09T12:05:11.766 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.760+0000 7f21f2c0c640 1 librados: init done 2024-04-09T12:05:11.766 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.761+0000 7f21f2c0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:11.766 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.761+0000 7f21f2c0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:11.766 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.761+0000 7f21f2c0c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:11.766 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.761+0000 7f21f2c0c640 1 -- 172.21.15.29:0/276063962 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ec13b8e0 con 0x7f21ec13eb00 2024-04-09T12:05:11.781 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.779+0000 7f21e97fa640 1 -- 172.21.15.29:0/276063962 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f21e400aa90 con 0x7f21ec13eb00 2024-04-09T12:05:11.781 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.779+0000 7f21e97fa640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f21d006c550 0x7f21d006ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:11.781 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.779+0000 7f21f09a8640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f21d006c550 0x7f21d006ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:11.781 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.779+0000 7f21f09a8640 10 monclient: get_auth_request con 0x7f21d006c550 auth_method 0 2024-04-09T12:05:11.781 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.780+0000 7f21e97fa640 10 client.4226.objecter ms_handle_connect 0x7f21d006c550 2024-04-09T12:05:11.782 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:11.780+0000 7f21f09a8640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f21d006c550 0x7f21d006ea10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009b40 tx=0x7f21e0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:12.044 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.042+0000 7f21e97fa640 1 -- 172.21.15.29:0/276063962 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4017+0+0 (secure 0 0 0) 0x7f21e40588c0 con 0x7f21ec13eb00 2024-04-09T12:05:12.044 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.042+0000 7f21e97fa640 10 client.4226.objecter ms_dispatch 0x7f21ec000b90 osd_map(18..18 src has 1..18) v4 2024-04-09T12:05:12.044 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.042+0000 7f21e97fa640 3 client.4226.objecter handle_osd_map got epochs [18,18] > 0 2024-04-09T12:05:12.044 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.042+0000 7f21e97fa640 3 client.4226.objecter handle_osd_map decoding full epoch 18 2024-04-09T12:05:12.045 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.042+0000 7f21e97fa640 20 client.4226.objecter dump_active .. 0 homeless 2024-04-09T12:05:12.045 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.042+0000 7f21e97fa640 1 -- 172.21.15.29:0/276063962 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f21e4054c00 con 0x7f21ec13eb00 2024-04-09T12:05:12.045 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.042+0000 7f21e97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:12.045 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.042+0000 7f21e97fa640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:12.093 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:12.086+0000 ae7c640 -1 osd.4 0 waiting for initial osdmap 2024-04-09T12:05:12.251 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.092+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.255 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.253+0000 7f21f2c0c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:12.255 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.253+0000 7f21f2c0c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:12.255 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.253+0000 7f21f2c0c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:12.255 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.253+0000 7f21f2c0c640 1 -- 172.21.15.29:0/276063962 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21ec13b8e0 con 0x7f21ec13eb00 2024-04-09T12:05:12.306 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.207+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.322 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.250+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.322 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.304+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.359 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.357+0000 7f21e97fa640 1 -- 172.21.15.29:0/276063962 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11094 (secure 0 0 0) 0x7f21ec13b8e0 con 0x7f21ec13eb00 2024-04-09T12:05:12.359 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.357+0000 7f21e97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:12.359 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.357+0000 7f21e97fa640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:12.359 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-09T12:05:12.359 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":18,"fsid":"1673ebad-34a7-414e-b498-c4f5250b317b","created":"2024-04-09T12:04:18.271948+0000","modified":"2024-04-09T12:05:08.470947+0000","last_up_change":"2024-04-09T12:05:05.061432+0000","last_in_change":"2024-04-09T12:04:23.695144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-09T12:05:04.691771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.690000057220459,"score_stable":7.690000057220459,"optimal_score":0.12999999523162842,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c929787-7de5-4d2f-9b36-3a165fa73386","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":35238},{"type":"v1","addr":"172.21.15.29:6809","nonce":35238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":35238},{"type":"v1","addr":"172.21.15.29:6811","nonce":35238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":35238},{"type":"v1","addr":"172.21.15.29:6815","nonce":35238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":35238},{"type":"v1","addr":"172.21.15.29:6813","nonce":35238}]},"public_addr":"172.21.15.29:6809/35238","cluster_addr":"172.21.15.29:6811/35238","heartbeat_back_addr":"172.21.15.29:6815/35238","heartbeat_front_addr":"172.21.15.29:6813/35238","state":["exists","up"]},{"osd":1,"uuid":"54d0b5c7-3415-4585-8a9b-c67a8ae94ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a343481-8465-4e19-989c-4a62c926338c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":35237},{"type":"v1","addr":"172.21.15.29:6801","nonce":35237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":35237},{"type":"v1","addr":"172.21.15.29:6803","nonce":35237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":35237},{"type":"v1","addr":"172.21.15.29:6807","nonce":35237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":35237},{"type":"v1","addr":"172.21.15.29:6805","nonce":35237}]},"public_addr":"172.21.15.29:6801/35237","cluster_addr":"172.21.15.29:6803/35237","heartbeat_back_addr":"172.21.15.29:6807/35237","heartbeat_front_addr":"172.21.15.29:6805/35237","state":["exists","up"]},{"osd":3,"uuid":"7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":35239},{"type":"v1","addr":"172.21.15.29:6817","nonce":35239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":35239},{"type":"v1","addr":"172.21.15.29:6819","nonce":35239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":35239},{"type":"v1","addr":"172.21.15.29:6823","nonce":35239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":35239},{"type":"v1","addr":"172.21.15.29:6821","nonce":35239}]},"public_addr":"172.21.15.29:6817/35239","cluster_addr":"172.21.15.29:6819/35239","heartbeat_back_addr":"172.21.15.29:6823/35239","heartbeat_front_addr":"172.21.15.29:6821/35239","state":["exists","up"]},{"osd":4,"uuid":"7f553202-73e9-496c-893f-185c61f66807","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84050623-d3f3-40ba-b63e-92d56a74bfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":35531},{"type":"v1","addr":"172.21.15.173:6826","nonce":35531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":35531},{"type":"v1","addr":"172.21.15.173:6829","nonce":35531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":35531},{"type":"v1","addr":"172.21.15.173:6833","nonce":35531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":35531},{"type":"v1","addr":"172.21.15.173:6831","nonce":35531}]},"public_addr":"172.21.15.173:6826/35531","cluster_addr":"172.21.15.173:6829/35531","heartbeat_back_addr":"172.21.15.173:6833/35531","heartbeat_front_addr":"172.21.15.173:6831/35531","state":["exists","up"]},{"osd":6,"uuid":"883e841f-8acc-4268-8e64-c556b10befa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":35530},{"type":"v1","addr":"172.21.15.173:6803","nonce":35530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":35530},{"type":"v1","addr":"172.21.15.173:6805","nonce":35530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":35530},{"type":"v1","addr":"172.21.15.173:6809","nonce":35530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":35530},{"type":"v1","addr":"172.21.15.173:6807","nonce":35530}]},"public_addr":"172.21.15.173:6803/35530","cluster_addr":"172.21.15.173:6805/35530","heartbeat_back_addr":"172.21.15.173:6809/35530","heartbeat_front_addr":"172.21.15.173:6807/35530","state":["exists","up"]},{"osd":7,"uuid":"126085be-23ad-45b6-951d-47886bdfa75c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:01.923058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:02.626090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:02.816164+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:00.598310+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:00.974235+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-09T12:05:12.363 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 10 librados: watch_flush enter 2024-04-09T12:05:12.363 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 10 librados: watch_flush exit 2024-04-09T12:05:12.363 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 20 client.4226.objecter shutdown clearing up homeless session... 2024-04-09T12:05:12.363 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 10 client.4226.objecter successfully canceled tick 2024-04-09T12:05:12.363 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 -- 172.21.15.29:0/276063962 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f21d006c550 msgr2=0x7f21d006ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:12.363 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f21d006c550 0x7f21d006ea10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009b40 tx=0x7f21e0009190 comp rx=0 tx=0).stop 2024-04-09T12:05:12.363 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 10 monclient: shutdown 2024-04-09T12:05:12.363 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:12.363 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 -- 172.21.15.29:0/276063962 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec13eb00 msgr2=0x7f21ec1323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:12.363 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec13eb00 0x7f21ec1323d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c7a0 tx=0x7f21e400cc60 comp rx=0 tx=0).stop 2024-04-09T12:05:12.364 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 -- 172.21.15.29:0/276063962 shutdown_connections 2024-04-09T12:05:12.364 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f21d006c550 0x7f21d006ea10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:12.364 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21ec13eb00 0x7f21ec1323d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:12.364 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21ec0b7c80 0x7f21ec139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:12.364 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 --2- 172.21.15.29:0/276063962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21ec0b1040 0x7f21ec13bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:12.364 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 -- 172.21.15.29:0/276063962 >> 172.21.15.29:0/276063962 conn(0x7f21ec071b70 msgr2=0x7f21ec13d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:12.364 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 -- 172.21.15.29:0/276063962 shutdown_connections 2024-04-09T12:05:12.364 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 -- 172.21.15.29:0/276063962 wait complete. 2024-04-09T12:05:12.364 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:12.360+0000 7f21f2c0c640 1 librados: shutdown 2024-04-09T12:05:12.373 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-04-09T12:05:12.479 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.322+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.499 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.478+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.532 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.497+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.532 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.519+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.566 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.531+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.588 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:05:12.572+0000 14462640 -1 osd.4 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-09T12:05:12.681 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.552+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.698 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.564+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.772 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.679+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:12.794 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.771+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:13.021 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:12.792+0000 5dc2480 -1 bdev(0x1947c340 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-04-09T12:05:14.052 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:14.045+0000 ae7c640 -1 osd.1 0 waiting for initial osdmap 2024-04-09T12:05:14.584 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:05:14.568+0000 14462640 -1 osd.1 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-09T12:05:15.792 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:01:09.420 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:15.883 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:09.511 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:15.908 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:01:09.536 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:15.942 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:09.570 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:15.950 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:01:09.578 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:16.026 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:01:09.655 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:16.183 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:09.811 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:16.207 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:01:09.835 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:16.289 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:01:09.917 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:19.179 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-09T12:05:19.269 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.266+0000 7f7566770640 10 monclient: get_monmap_and_config 2024-04-09T12:05:19.269 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.266+0000 7f7566770640 10 monclient: build_initial_monmap 2024-04-09T12:05:19.269 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.266+0000 7f7566770640 10 monclient: monmap: 2024-04-09T12:05:19.269 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:05:19.269 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:19.269 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:05:19.267939+0000 2024-04-09T12:05:19.270 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:05:19.267939+0000 2024-04-09T12:05:19.270 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:19.270 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:19.270 INFO:teuthology.misc.health.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:19.270 INFO:teuthology.misc.health.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:19.270 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:19.270 INFO:teuthology.misc.health.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:19.270 INFO:teuthology.misc.health.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:19.270 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:19.272 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 1 Processor -- start 2024-04-09T12:05:19.272 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 1 -- start start 2024-04-09T12:05:19.272 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 10 monclient: init 2024-04-09T12:05:19.272 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:19.272 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 10 monclient: _add_conns ranks=[0,3,4,1,2] 2024-04-09T12:05:19.272 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f75600b4410 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:19.272 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7560141750 0x7f7560141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:19.272 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 10 monclient(hunting): picked mon.noname-a con 0x7f7560141750 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f756013e540 0x7f756013e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 10 monclient(hunting): picked mon.noname-c con 0x7f756013e540 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75600a96c0 con 0x7f75600b4410 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75600a92a0 con 0x7f7560141750 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75600b47f0 con 0x7f756013e540 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.267+0000 7f7566770640 10 monclient(hunting): authenticate will time out at 1385.387898s 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.268+0000 7f755f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7560141750 0x7f7560141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.268+0000 7f7564d0d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f756013e540 0x7f756013e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.268+0000 7f7564d0d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f756013e540 0x7f756013e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:40894/0 (socket says 172.21.15.29:40894) 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.268+0000 7f7564d0d640 1 -- 172.21.15.29:0/315719298 learned_addr learned my addr 172.21.15.29:0/315719298 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:19.273 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.268+0000 7f7564d0d640 10 monclient(hunting): get_auth_request con 0x7f756013e540 auth_method 0 2024-04-09T12:05:19.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.268+0000 7f7564d0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:19.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.268+0000 7f7564d0d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:19.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.268+0000 7f7564d0d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:19.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.269+0000 7f755f7fe640 10 monclient(hunting): get_auth_request con 0x7f7560141750 auth_method 0 2024-04-09T12:05:19.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.269+0000 7f755f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:19.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.269+0000 7f755f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:19.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.269+0000 7f755f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:19.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.269+0000 7f7564d0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:19.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.269+0000 7f7564d0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:19.274 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.269+0000 7f7564d0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:19.275 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.270+0000 7f755f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:19.275 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.270+0000 7f755f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:19.275 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.270+0000 7f755f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:19.275 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.271+0000 7f7564d0d640 10 monclient(hunting): handle_auth_done global_id 4291 payload 274 2024-04-09T12:05:19.275 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.271+0000 7f7564d0d640 1 -- 172.21.15.29:0/315719298 >> v2:172.21.15.29:3300/0 conn(0x7f7560141750 msgr2=0x7f7560141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:19.275 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.271+0000 7f7564d0d640 1 --2- 172.21.15.29:0/315719298 >> v2:172.21.15.29:3300/0 conn(0x7f7560141750 0x7f7560141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:19.275 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.271+0000 7f7564d0d640 1 -- 172.21.15.29:0/315719298 >> v1:172.21.15.29:6789/0 conn(0x7f75600b4410 legacy=0x7f75600a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:19.276 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.271+0000 7f7564d0d640 10 monclient: _finish_hunting 0 2024-04-09T12:05:19.276 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.271+0000 7f7564d0d640 1 monclient: found mon.noname-c 2024-04-09T12:05:19.276 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.271+0000 7f7564d0d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:19.276 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.271+0000 7f7564d0d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:05:19.276 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.271+0000 7f7564d0d640 1 -- 172.21.15.29:0/315719298 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75600aa840 con 0x7f756013e540 2024-04-09T12:05:19.276 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.273+0000 7f7564d0d640 1 --2- 172.21.15.29:0/315719298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f756013e540 0x7f756013e9d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75600b3070 tx=0x7f755802bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93eda121dc275d1c server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:19.279 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.276+0000 7f755effd640 1 -- 172.21.15.29:0/315719298 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755802cb20 con 0x7f756013e540 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 10 monclient: dump: 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:19.280 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 10 monclient: _finish_auth 0 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 5 monclient: authenticate success, global_id 4291 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 1 -- 172.21.15.29:0/315719298 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755802cc80 con 0x7f756013e540 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 4 set_mon_vals no callback set 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 1 -- 172.21.15.29:0/315719298 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75580343f0 con 0x7f756013e540 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f755effd640 10 monclient: dump: 2024-04-09T12:05:19.281 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:19.282 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:19.282 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:19.282 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:19.282 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:19.282 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:19.282 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:19.282 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:19.282 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:19.282 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:19.285 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 10 monclient: shutdown 2024-04-09T12:05:19.285 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:19.285 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 1 -- 172.21.15.29:0/315719298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f756013e540 msgr2=0x7f756013e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:19.285 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 1 --2- 172.21.15.29:0/315719298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f756013e540 0x7f756013e9d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75600b3070 tx=0x7f755802bf80 comp rx=0 tx=0).stop 2024-04-09T12:05:19.285 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 1 -- 172.21.15.29:0/315719298 shutdown_connections 2024-04-09T12:05:19.285 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 1 --2- 172.21.15.29:0/315719298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f756013e540 0x7f756013e9d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 1 --2- 172.21.15.29:0/315719298 >> v2:172.21.15.29:3300/0 conn(0x7f7560141750 0x7f7560141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 1 -- 172.21.15.29:0/315719298 >> 172.21.15.29:0/315719298 conn(0x7f7560071960 msgr2=0x7f7560071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 1 -- 172.21.15.29:0/315719298 shutdown_connections 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.277+0000 7f7566770640 1 -- 172.21.15.29:0/315719298 wait complete. 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.278+0000 7f7566770640 10 monclient: build_initial_monmap 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.278+0000 7f7566770640 10 monclient: monmap: 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:epoch 0 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:created 0.000000 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:19.286 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.278+0000 7f7566770640 1 librados: starting msgr at 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.278+0000 7f7566770640 1 librados: starting objecter 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.278+0000 7f7566770640 1 Processor -- start 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.278+0000 7f7566770640 1 -- start start 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.278+0000 7f7566770640 1 librados: setting wanted keys 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.278+0000 7f7566770640 1 librados: calling monclient init 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.278+0000 7f7566770640 10 monclient: init 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75600b4410 0x7f75600b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 10 monclient(hunting): picked mon.noname-b con 0x7f75600b4410 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:19.287 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756013e540 0x7f75601cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 10 monclient(hunting): picked mon.noname-a con 0x7f756013e540 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7560141750 0x7f75600b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 10 monclient(hunting): picked mon.noname-c con 0x7f7560141750 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75600b5410 con 0x7f756013e540 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75600b58a0 con 0x7f75600b4410 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75600b6880 con 0x7f7560141750 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.279+0000 7f7566770640 10 monclient(hunting): authenticate will time out at 1385.399516s 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75600b4410 0x7f75600b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756013e540 0x7f75601cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:19.288 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f7564d0d640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7560141750 0x7f75600b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:19.289 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75600b4410 0x7f75600b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:40896/0 (socket says 172.21.15.29:40896) 2024-04-09T12:05:19.289 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755ffff640 1 -- 172.21.15.29:0/2432829235 learned_addr learned my addr 172.21.15.29:0/2432829235 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:19.289 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755ffff640 10 monclient(hunting): get_auth_request con 0x7f75600b4410 auth_method 0 2024-04-09T12:05:19.289 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:19.289 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755ffff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:19.289 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:19.289 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755f7fe640 10 monclient(hunting): get_auth_request con 0x7f756013e540 auth_method 0 2024-04-09T12:05:19.289 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:19.289 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f7564d0d640 10 monclient(hunting): get_auth_request con 0x7f7560141750 auth_method 0 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f7564d0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f7564d0d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f7564d0d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.280+0000 7f755ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.281+0000 7f755f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.281+0000 7f755f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.281+0000 7f755f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.281+0000 7f7564d0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.281+0000 7f7564d0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:19.290 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.281+0000 7f7564d0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:19.293 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.283+0000 7f755ffff640 10 monclient(hunting): handle_auth_done global_id 4294 payload 824 2024-04-09T12:05:19.293 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.283+0000 7f755ffff640 1 -- 172.21.15.29:0/2432829235 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7560141750 msgr2=0x7f75600b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:19.293 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.283+0000 7f755ffff640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7560141750 0x7f75600b6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:19.293 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.283+0000 7f755ffff640 1 -- 172.21.15.29:0/2432829235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756013e540 msgr2=0x7f75601cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:19.293 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.283+0000 7f755ffff640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756013e540 0x7f75601cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:19.293 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.283+0000 7f755ffff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:19.293 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.283+0000 7f755ffff640 1 monclient: found mon.noname-b 2024-04-09T12:05:19.293 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.283+0000 7f755ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:19.293 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.283+0000 7f755ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:19.293 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.283+0000 7f755ffff640 1 -- 172.21.15.29:0/2432829235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7558009b30 con 0x7f75600b4410 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.285+0000 7f755ffff640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75600b4410 0x7f75600b4d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f755000c450 tx=0x7f755000c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.285+0000 7f755cff9640 10 client.?.objecter ms_handle_connect 0x7f75600b4410 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.285+0000 7f755cff9640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 1 -- 172.21.15.29:0/2432829235 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75500052d0 con 0x7f75600b4410 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 10 monclient: dump: 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:19.294 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 10 monclient: _finish_auth 0 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 10 monclient: _check_auth_tickets 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 1 -- 172.21.15.29:0/2432829235 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7550005430 con 0x7f75600b4410 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f7566770640 5 monclient: authenticate success, global_id 4294 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f7566770640 10 monclient: _renew_subs 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 1 -- 172.21.15.29:0/2432829235 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7550012870 con 0x7f75600b4410 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f7566770640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:19.295 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f7566770640 1 -- 172.21.15.29:0/2432829235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75601cbad0 con 0x7f75600b4410 2024-04-09T12:05:19.296 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:19.296 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:19.296 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755cff9640 10 monclient: dump: 2024-04-09T12:05:19.296 INFO:teuthology.misc.health.smithi029.stderr:epoch 1 2024-04-09T12:05:19.296 INFO:teuthology.misc.health.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:19.296 INFO:teuthology.misc.health.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:19.296 INFO:teuthology.misc.health.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:19.296 INFO:teuthology.misc.health.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:19.296 INFO:teuthology.misc.health.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:19.296 INFO:teuthology.misc.health.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr: 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f755e7fc640 4 set_mon_vals no callback set 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f7566770640 10 client.4294.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f7566770640 10 monclient: _renew_subs 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f7566770640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f7566770640 1 -- 172.21.15.29:0/2432829235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75600b76a0 con 0x7f75600b4410 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.289+0000 7f7566770640 1 librados: init done 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.290+0000 7f7566770640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.290+0000 7f7566770640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.290+0000 7f7566770640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:19.297 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.290+0000 7f7566770640 1 -- 172.21.15.29:0/2432829235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756004e160 con 0x7f75600b4410 2024-04-09T12:05:19.311 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.308+0000 7f755cff9640 1 -- 172.21.15.29:0/2432829235 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75500129d0 con 0x7f75600b4410 2024-04-09T12:05:19.311 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.308+0000 7f755cff9640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f754c06c5e0 0x7f754c06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:19.311 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.309+0000 7f755f7fe640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f754c06c5e0 0x7f754c06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:19.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.309+0000 7f755f7fe640 10 monclient: get_auth_request con 0x7f754c06c5e0 auth_method 0 2024-04-09T12:05:19.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.309+0000 7f755f7fe640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f754c06c5e0 0x7f754c06eaa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f75601c84e0 tx=0x7f7554009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:19.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.309+0000 7f755cff9640 10 client.4294.objecter ms_handle_connect 0x7f754c06c5e0 2024-04-09T12:05:19.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.310+0000 7f755cff9640 1 -- 172.21.15.29:0/2432829235 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7550058770 con 0x7f75600b4410 2024-04-09T12:05:19.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.310+0000 7f755cff9640 10 client.4294.objecter ms_dispatch 0x7f7560000b90 osd_map(22..22 src has 1..22) v4 2024-04-09T12:05:19.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.310+0000 7f755cff9640 3 client.4294.objecter handle_osd_map got epochs [22,22] > 0 2024-04-09T12:05:19.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.310+0000 7f755cff9640 3 client.4294.objecter handle_osd_map decoding full epoch 22 2024-04-09T12:05:19.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.310+0000 7f755cff9640 20 client.4294.objecter dump_active .. 0 homeless 2024-04-09T12:05:19.550 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.547+0000 7f755cff9640 1 -- 172.21.15.29:0/2432829235 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f7550087e60 con 0x7f75600b4410 2024-04-09T12:05:19.550 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.547+0000 7f755cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:19.551 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.547+0000 7f755cff9640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:19.731 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.728+0000 7f7566770640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:19.731 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.728+0000 7f7566770640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:19.731 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.728+0000 7f7566770640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:19.731 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.728+0000 7f7566770640 1 -- 172.21.15.29:0/2432829235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7560066090 con 0x7f75600b4410 2024-04-09T12:05:19.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.816+0000 7f755cff9640 1 -- 172.21.15.29:0/2432829235 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+12383 (secure 0 0 0) 0x7f7550058540 con 0x7f75600b4410 2024-04-09T12:05:19.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.816+0000 7f755cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:19.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.816+0000 7f755cff9640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:19.820 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-09T12:05:19.820 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":22,"fsid":"1673ebad-34a7-414e-b498-c4f5250b317b","created":"2024-04-09T12:04:18.271948+0000","modified":"2024-04-09T12:05:16.774381+0000","last_up_change":"2024-04-09T12:05:15.358605+0000","last_in_change":"2024-04-09T12:04:23.695144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-09T12:05:04.691771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c929787-7de5-4d2f-9b36-3a165fa73386","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":35238},{"type":"v1","addr":"172.21.15.29:6809","nonce":35238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":35238},{"type":"v1","addr":"172.21.15.29:6811","nonce":35238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":35238},{"type":"v1","addr":"172.21.15.29:6815","nonce":35238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":35238},{"type":"v1","addr":"172.21.15.29:6813","nonce":35238}]},"public_addr":"172.21.15.29:6809/35238","cluster_addr":"172.21.15.29:6811/35238","heartbeat_back_addr":"172.21.15.29:6815/35238","heartbeat_front_addr":"172.21.15.29:6813/35238","state":["exists","up"]},{"osd":1,"uuid":"54d0b5c7-3415-4585-8a9b-c67a8ae94ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":35236},{"type":"v1","addr":"172.21.15.29:6825","nonce":35236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":35236},{"type":"v1","addr":"172.21.15.29:6827","nonce":35236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":35236},{"type":"v1","addr":"172.21.15.29:6831","nonce":35236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":35236},{"type":"v1","addr":"172.21.15.29:6829","nonce":35236}]},"public_addr":"172.21.15.29:6825/35236","cluster_addr":"172.21.15.29:6827/35236","heartbeat_back_addr":"172.21.15.29:6831/35236","heartbeat_front_addr":"172.21.15.29:6829/35236","state":["exists","up"]},{"osd":2,"uuid":"7a343481-8465-4e19-989c-4a62c926338c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":35237},{"type":"v1","addr":"172.21.15.29:6801","nonce":35237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":35237},{"type":"v1","addr":"172.21.15.29:6803","nonce":35237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":35237},{"type":"v1","addr":"172.21.15.29:6807","nonce":35237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":35237},{"type":"v1","addr":"172.21.15.29:6805","nonce":35237}]},"public_addr":"172.21.15.29:6801/35237","cluster_addr":"172.21.15.29:6803/35237","heartbeat_back_addr":"172.21.15.29:6807/35237","heartbeat_front_addr":"172.21.15.29:6805/35237","state":["exists","up"]},{"osd":3,"uuid":"7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":35239},{"type":"v1","addr":"172.21.15.29:6817","nonce":35239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":35239},{"type":"v1","addr":"172.21.15.29:6819","nonce":35239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":35239},{"type":"v1","addr":"172.21.15.29:6823","nonce":35239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":35239},{"type":"v1","addr":"172.21.15.29:6821","nonce":35239}]},"public_addr":"172.21.15.29:6817/35239","cluster_addr":"172.21.15.29:6819/35239","heartbeat_back_addr":"172.21.15.29:6823/35239","heartbeat_front_addr":"172.21.15.29:6821/35239","state":["exists","up"]},{"osd":4,"uuid":"7f553202-73e9-496c-893f-185c61f66807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":35529},{"type":"v1","addr":"172.21.15.173:6819","nonce":35529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":35529},{"type":"v1","addr":"172.21.15.173:6821","nonce":35529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6825","nonce":35529},{"type":"v1","addr":"172.21.15.173:6827","nonce":35529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":35529},{"type":"v1","addr":"172.21.15.173:6824","nonce":35529}]},"public_addr":"172.21.15.173:6819/35529","cluster_addr":"172.21.15.173:6821/35529","heartbeat_back_addr":"172.21.15.173:6827/35529","heartbeat_front_addr":"172.21.15.173:6824/35529","state":["exists","up"]},{"osd":5,"uuid":"84050623-d3f3-40ba-b63e-92d56a74bfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":35531},{"type":"v1","addr":"172.21.15.173:6826","nonce":35531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":35531},{"type":"v1","addr":"172.21.15.173:6829","nonce":35531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":35531},{"type":"v1","addr":"172.21.15.173:6833","nonce":35531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":35531},{"type":"v1","addr":"172.21.15.173:6831","nonce":35531}]},"public_addr":"172.21.15.173:6826/35531","cluster_addr":"172.21.15.173:6829/35531","heartbeat_back_addr":"172.21.15.173:6833/35531","heartbeat_front_addr":"172.21.15.173:6831/35531","state":["exists","up"]},{"osd":6,"uuid":"883e841f-8acc-4268-8e64-c556b10befa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":35530},{"type":"v1","addr":"172.21.15.173:6803","nonce":35530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":35530},{"type":"v1","addr":"172.21.15.173:6805","nonce":35530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":35530},{"type":"v1","addr":"172.21.15.173:6809","nonce":35530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":35530},{"type":"v1","addr":"172.21.15.173:6807","nonce":35530}]},"public_addr":"172.21.15.173:6803/35530","cluster_addr":"172.21.15.173:6805/35530","heartbeat_back_addr":"172.21.15.173:6809/35530","heartbeat_front_addr":"172.21.15.173:6807/35530","state":["exists","up"]},{"osd":7,"uuid":"126085be-23ad-45b6-951d-47886bdfa75c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":35532},{"type":"v1","addr":"172.21.15.173:6811","nonce":35532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":35532},{"type":"v1","addr":"172.21.15.173:6813","nonce":35532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":35532},{"type":"v1","addr":"172.21.15.173:6817","nonce":35532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":35532},{"type":"v1","addr":"172.21.15.173:6815","nonce":35532}]},"public_addr":"172.21.15.173:6811/35532","cluster_addr":"172.21.15.173:6813/35532","heartbeat_back_addr":"172.21.15.173:6817/35532","heartbeat_front_addr":"172.21.15.173:6815/35532","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:01.923058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:03.497855+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:02.626090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:02.816164+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:01.755586+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:00.598310+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:00.974235+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:01.169040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-09T12:05:19.822 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 10 librados: watch_flush enter 2024-04-09T12:05:19.822 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 10 librados: watch_flush exit 2024-04-09T12:05:19.822 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 20 client.4294.objecter shutdown clearing up homeless session... 2024-04-09T12:05:19.822 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 10 client.4294.objecter successfully canceled tick 2024-04-09T12:05:19.822 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 -- 172.21.15.29:0/2432829235 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f754c06c5e0 msgr2=0x7f754c06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:19.822 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f754c06c5e0 0x7f754c06eaa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f75601c84e0 tx=0x7f7554009190 comp rx=0 tx=0).stop 2024-04-09T12:05:19.822 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 10 monclient: shutdown 2024-04-09T12:05:19.822 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:19.822 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 -- 172.21.15.29:0/2432829235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75600b4410 msgr2=0x7f75600b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:19.822 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75600b4410 0x7f75600b4d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f755000c450 tx=0x7f755000c910 comp rx=0 tx=0).stop 2024-04-09T12:05:19.823 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 -- 172.21.15.29:0/2432829235 shutdown_connections 2024-04-09T12:05:19.823 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f754c06c5e0 0x7f754c06eaa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:19.823 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7560141750 0x7f75600b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:19.823 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756013e540 0x7f75601cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:19.823 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 --2- 172.21.15.29:0/2432829235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75600b4410 0x7f75600b4d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:19.823 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 -- 172.21.15.29:0/2432829235 >> 172.21.15.29:0/2432829235 conn(0x7f7560071960 msgr2=0x7f75600a8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:19.823 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 -- 172.21.15.29:0/2432829235 shutdown_connections 2024-04-09T12:05:19.823 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 -- 172.21.15.29:0/2432829235 wait complete. 2024-04-09T12:05:19.824 INFO:teuthology.misc.health.smithi029.stderr:2024-04-09T12:05:19.818+0000 7f7566770640 1 librados: shutdown 2024-04-09T12:05:19.831 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-09T12:05:19.831 INFO:tasks.ceph:Creating RBD pool 2024-04-09T12:05:19.832 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-09T12:05:19.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.933+0000 7f192f660640 10 monclient: get_monmap_and_config 2024-04-09T12:05:19.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.933+0000 7f192f660640 10 monclient: build_initial_monmap 2024-04-09T12:05:19.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.933+0000 7f192f660640 10 monclient: monmap: 2024-04-09T12:05:19.937 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:19.937 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:19.937 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:19.935336+0000 2024-04-09T12:05:19.937 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:19.935336+0000 2024-04-09T12:05:19.937 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:19.937 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:19.937 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:19.938 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:19.938 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:19.938 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:19.938 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:19.938 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:19.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.934+0000 7f192f660640 1 Processor -- start 2024-04-09T12:05:19.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.934+0000 7f192f660640 1 -- start start 2024-04-09T12:05:19.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.934+0000 7f192f660640 10 monclient: init 2024-04-09T12:05:19.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:19.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f19280b42f0 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1928141660 0x7f1928141a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 10 monclient(hunting): picked mon.noname-a con 0x7f1928141660 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f192813e7f0 0x7f192813ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 10 monclient(hunting): picked mon.noname-c con 0x7f192813e7f0 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19280aa450 con 0x7f19280b42f0 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19280b46d0 con 0x7f1928141660 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19280aa730 con 0x7f192813e7f0 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.935+0000 7f192f660640 10 monclient(hunting): authenticate will time out at 1386.055314s 2024-04-09T12:05:19.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.936+0000 7f192cbfb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1928141660 0x7f1928141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:19.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.937+0000 7f192cbfb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1928141660 0x7f1928141a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47922/0 (socket says 172.21.15.29:47922) 2024-04-09T12:05:19.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.937+0000 7f192cbfb640 1 -- 172.21.15.29:0/3903842963 learned_addr learned my addr 172.21.15.29:0/3903842963 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:19.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.937+0000 7f192cbfb640 10 monclient(hunting): get_auth_request con 0x7f1928141660 auth_method 0 2024-04-09T12:05:19.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.937+0000 7f192cbfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:19.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.937+0000 7f192cbfb640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:19.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.937+0000 7f192cbfb640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:19.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.938+0000 7f192cbfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:19.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.938+0000 7f192cbfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:19.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.938+0000 7f192cbfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:19.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.940+0000 7f192dbfd640 1 --2- 172.21.15.29:0/3903842963 >> v2:172.21.15.173:3300/0 conn(0x7f192813e7f0 0x7f192813ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:19.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.941+0000 7f192dbfd640 10 monclient(hunting): get_auth_request con 0x7f192813e7f0 auth_method 0 2024-04-09T12:05:19.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.941+0000 7f192dbfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:19.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.941+0000 7f192dbfd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:19.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.941+0000 7f192dbfd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:19.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.942+0000 7f192dbfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:19.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.942+0000 7f192dbfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:19.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.942+0000 7f192dbfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:19.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.983+0000 7f192dbfd640 10 monclient(hunting): handle_auth_done global_id 4297 payload 274 2024-04-09T12:05:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.983+0000 7f192dbfd640 1 -- 172.21.15.29:0/3903842963 >> v2:172.21.15.29:3300/0 conn(0x7f1928141660 msgr2=0x7f1928141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.983+0000 7f192dbfd640 1 --2- 172.21.15.29:0/3903842963 >> v2:172.21.15.29:3300/0 conn(0x7f1928141660 0x7f1928141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.983+0000 7f192dbfd640 1 -- 172.21.15.29:0/3903842963 >> v1:172.21.15.173:6789/0 conn(0x7f19280b42f0 legacy=0x7f19280a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.983+0000 7f192dbfd640 10 monclient: _finish_hunting 0 2024-04-09T12:05:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.983+0000 7f192dbfd640 1 monclient: found mon.noname-c 2024-04-09T12:05:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.983+0000 7f192dbfd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.983+0000 7f192dbfd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:05:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.983+0000 7f192dbfd640 1 -- 172.21.15.29:0/3903842963 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280a9070 con 0x7f192813e7f0 2024-04-09T12:05:19.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.993+0000 7f192dbfd640 1 --2- 172.21.15.29:0/3903842963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192813e7f0 0x7f192813ec40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19280b3310 tx=0x7f192002be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be2d47f8a4ee093e server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:19.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.995+0000 7f191ffff640 1 -- 172.21.15.29:0/3903842963 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192002cbf0 con 0x7f192813e7f0 2024-04-09T12:05:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 10 monclient: dump: 2024-04-09T12:05:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 10 monclient: _finish_auth 0 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 10 monclient: _check_auth_tickets 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 1 -- 172.21.15.29:0/3903842963 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192002cd50 con 0x7f192813e7f0 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 1 -- 172.21.15.29:0/3903842963 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920034660 con 0x7f192813e7f0 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 5 monclient: authenticate success, global_id 4297 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 4 set_mon_vals no callback set 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f191ffff640 10 monclient: dump: 2024-04-09T12:05:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:20.002 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:20.002 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:20.002 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 10 monclient: shutdown 2024-04-09T12:05:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 1 -- 172.21.15.29:0/3903842963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192813e7f0 msgr2=0x7f192813ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 1 --2- 172.21.15.29:0/3903842963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192813e7f0 0x7f192813ec40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19280b3310 tx=0x7f192002be40 comp rx=0 tx=0).stop 2024-04-09T12:05:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 1 -- 172.21.15.29:0/3903842963 shutdown_connections 2024-04-09T12:05:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 1 --2- 172.21.15.29:0/3903842963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192813e7f0 0x7f192813ec40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 1 --2- 172.21.15.29:0/3903842963 >> v2:172.21.15.29:3300/0 conn(0x7f1928141660 0x7f1928141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 1 -- 172.21.15.29:0/3903842963 >> 172.21.15.29:0/3903842963 conn(0x7f1928065f30 msgr2=0x7f1928066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 1 -- 172.21.15.29:0/3903842963 shutdown_connections 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.996+0000 7f192f660640 1 -- 172.21.15.29:0/3903842963 wait complete. 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.997+0000 7f192f660640 10 monclient: build_initial_monmap 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.997+0000 7f192f660640 10 monclient: monmap: 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:20.007 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.997+0000 7f192f660640 1 librados: starting msgr at 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.997+0000 7f192f660640 1 librados: starting objecter 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.997+0000 7f192f660640 1 Processor -- start 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 1 -- start start 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 1 librados: setting wanted keys 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 1 librados: calling monclient init 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 10 monclient: init 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19280b42f0 0x7f192813a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 10 monclient(hunting): picked mon.noname-a con 0x7f19280b42f0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192813e7f0 0x7f192813b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 10 monclient(hunting): picked mon.noname-b con 0x7f192813e7f0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:20.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1928141660 0x7f19281d9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 10 monclient(hunting): picked mon.noname-c con 0x7f1928141660 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19281d9920 con 0x7f19280b42f0 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19281d95d0 con 0x7f192813e7f0 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192813b5f0 con 0x7f1928141660 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.998+0000 7f192f660640 10 monclient(hunting): authenticate will time out at 1386.118598s 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192d3fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19280b42f0 0x7f192813a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192dbfd640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1928141660 0x7f19281d9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192cbfb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192813e7f0 0x7f192813b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192cbfb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192813e7f0 0x7f192813b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:40920/0 (socket says 172.21.15.29:40920) 2024-04-09T12:05:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192cbfb640 1 -- 172.21.15.29:0/1742866819 learned_addr learned my addr 172.21.15.29:0/1742866819 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192cbfb640 10 monclient(hunting): get_auth_request con 0x7f192813e7f0 auth_method 0 2024-04-09T12:05:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192cbfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192cbfb640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192cbfb640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192d3fc640 10 monclient(hunting): get_auth_request con 0x7f19280b42f0 auth_method 0 2024-04-09T12:05:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192d3fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192d3fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192d3fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192dbfd640 10 monclient(hunting): get_auth_request con 0x7f1928141660 auth_method 0 2024-04-09T12:05:20.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192dbfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:20.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192dbfd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:20.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192dbfd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:20.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192d3fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:20.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:19.999+0000 7f192d3fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:20.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.000+0000 7f192d3fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:20.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.000+0000 7f192cbfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:20.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.000+0000 7f192cbfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.000+0000 7f192cbfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.000+0000 7f192dbfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.000+0000 7f192dbfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.000+0000 7f192dbfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.002+0000 7f192cbfb640 10 monclient(hunting): handle_auth_done global_id 4303 payload 824 2024-04-09T12:05:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.002+0000 7f192cbfb640 1 -- 172.21.15.29:0/1742866819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1928141660 msgr2=0x7f19281d9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.002+0000 7f192cbfb640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1928141660 0x7f19281d9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.002+0000 7f192cbfb640 1 -- 172.21.15.29:0/1742866819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19280b42f0 msgr2=0x7f192813a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.002+0000 7f192cbfb640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19280b42f0 0x7f192813a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.002+0000 7f192cbfb640 10 monclient: _finish_hunting 0 2024-04-09T12:05:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.002+0000 7f192cbfb640 1 monclient: found mon.noname-b 2024-04-09T12:05:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.002+0000 7f192cbfb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.002+0000 7f192cbfb640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.002+0000 7f192cbfb640 1 -- 172.21.15.29:0/1742866819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1920009a70 con 0x7f192813e7f0 2024-04-09T12:05:20.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.004+0000 7f192cbfb640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192813e7f0 0x7f192813b0b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f191800e870 tx=0x7f191800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.004+0000 7f191dffb640 10 client.?.objecter ms_handle_connect 0x7f192813e7f0 2024-04-09T12:05:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.004+0000 7f191dffb640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 1 -- 172.21.15.29:0/1742866819 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191800c8e0 con 0x7f192813e7f0 2024-04-09T12:05:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 10 monclient: dump: 2024-04-09T12:05:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:20.017 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:20.017 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:20.017 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:20.017 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:20.017 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:20.017 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:20.017 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:20.017 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:20.018 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 10 monclient: _finish_auth 0 2024-04-09T12:05:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 10 monclient: _check_auth_tickets 2024-04-09T12:05:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 1 -- 172.21.15.29:0/1742866819 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191800ca40 con 0x7f192813e7f0 2024-04-09T12:05:20.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:20.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 1 -- 172.21.15.29:0/1742866819 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191800cdf0 con 0x7f192813e7f0 2024-04-09T12:05:20.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:20.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:20.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191dffb640 10 monclient: dump: 2024-04-09T12:05:20.019 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:20.019 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:20.020 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f191effd640 4 set_mon_vals no callback set 2024-04-09T12:05:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f192f660640 5 monclient: authenticate success, global_id 4303 2024-04-09T12:05:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f192f660640 10 monclient: _renew_subs 2024-04-09T12:05:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f192f660640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f192f660640 1 -- 172.21.15.29:0/1742866819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19280abaa0 con 0x7f192813e7f0 2024-04-09T12:05:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f192f660640 10 client.4303.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f192f660640 10 monclient: _renew_subs 2024-04-09T12:05:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f192f660640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:20.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f192f660640 1 -- 172.21.15.29:0/1742866819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19281da460 con 0x7f192813e7f0 2024-04-09T12:05:20.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.008+0000 7f192f660640 1 librados: init done 2024-04-09T12:05:20.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.009+0000 7f192f660640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:20.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.009+0000 7f192f660640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:20.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.009+0000 7f192f660640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:20.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.009+0000 7f192f660640 1 -- 172.21.15.29:0/1742866819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1928139dc0 con 0x7f192813e7f0 2024-04-09T12:05:20.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.028+0000 7f191dffb640 1 -- 172.21.15.29:0/1742866819 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1918013470 con 0x7f192813e7f0 2024-04-09T12:05:20.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.028+0000 7f191dffb640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f190c06c5e0 0x7f190c06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:20.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.028+0000 7f192d3fc640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f190c06c5e0 0x7f190c06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:20.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.028+0000 7f192d3fc640 10 monclient: get_auth_request con 0x7f190c06c5e0 auth_method 0 2024-04-09T12:05:20.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.029+0000 7f191dffb640 10 client.4303.objecter ms_handle_connect 0x7f190c06c5e0 2024-04-09T12:05:20.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.029+0000 7f192d3fc640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f190c06c5e0 0x7f190c06eaa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1924000f60 tx=0x7f1924009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:20.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.029+0000 7f191dffb640 1 -- 172.21.15.29:0/1742866819 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1918058960 con 0x7f192813e7f0 2024-04-09T12:05:20.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.029+0000 7f191dffb640 10 client.4303.objecter ms_dispatch 0x7f1928000b90 osd_map(22..22 src has 1..22) v4 2024-04-09T12:05:20.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.029+0000 7f191dffb640 3 client.4303.objecter handle_osd_map got epochs [22,22] > 0 2024-04-09T12:05:20.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.029+0000 7f191dffb640 3 client.4303.objecter handle_osd_map decoding full epoch 22 2024-04-09T12:05:20.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.029+0000 7f191dffb640 20 client.4303.objecter dump_active .. 0 homeless 2024-04-09T12:05:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.262+0000 7f191dffb640 1 -- 172.21.15.29:0/1742866819 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f1918054ca0 con 0x7f192813e7f0 2024-04-09T12:05:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.262+0000 7f191dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.262+0000 7f191dffb640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:20.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.441+0000 7f192f660640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-04-09T12:05:20.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.441+0000 7f192f660640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-04-09T12:05:20.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.441+0000 7f192f660640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:20.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:20.441+0000 7f192f660640 1 -- 172.21.15.29:0/1742866819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1928139dc0 con 0x7f192813e7f0 2024-04-09T12:05:21.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.158+0000 7f191dffb640 1 -- 172.21.15.29:0/1742866819 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v23) v1 ==== 109+0+0 (secure 0 0 0) 0x7f1928139dc0 con 0x7f192813e7f0 2024-04-09T12:05:21.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.158+0000 7f191dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-04-09T12:05:21.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.158+0000 7f191dffb640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2024-04-09T12:05:21.161 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'rbd' created 2024-04-09T12:05:21.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.160+0000 7f192f660640 10 librados: watch_flush enter 2024-04-09T12:05:21.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.160+0000 7f192f660640 10 librados: watch_flush exit 2024-04-09T12:05:21.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.160+0000 7f192f660640 20 client.4303.objecter shutdown clearing up homeless session... 2024-04-09T12:05:21.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.160+0000 7f192f660640 10 client.4303.objecter successfully canceled tick 2024-04-09T12:05:21.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 -- 172.21.15.29:0/1742866819 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f190c06c5e0 msgr2=0x7f190c06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f190c06c5e0 0x7f190c06eaa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1924000f60 tx=0x7f1924009040 comp rx=0 tx=0).stop 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 10 monclient: shutdown 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 -- 172.21.15.29:0/1742866819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192813e7f0 msgr2=0x7f192813b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192813e7f0 0x7f192813b0b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f191800e870 tx=0x7f191800ed30 comp rx=0 tx=0).stop 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 -- 172.21.15.29:0/1742866819 shutdown_connections 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f190c06c5e0 0x7f190c06eaa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1928141660 0x7f19281d9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192813e7f0 0x7f192813b0b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 --2- 172.21.15.29:0/1742866819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19280b42f0 0x7f192813a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 -- 172.21.15.29:0/1742866819 >> 172.21.15.29:0/1742866819 conn(0x7f1928065f30 msgr2=0x7f192813cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 -- 172.21.15.29:0/1742866819 shutdown_connections 2024-04-09T12:05:21.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 -- 172.21.15.29:0/1742866819 wait complete. 2024-04-09T12:05:21.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.161+0000 7f192f660640 1 librados: shutdown 2024-04-09T12:05:21.174 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-09T12:05:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.274+0000 7f0be0cf5640 10 monclient: get_monmap_and_config 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.274+0000 7f0be0cf5640 10 monclient: build_initial_monmap 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.274+0000 7f0be0cf5640 10 monclient: monmap: 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:21.276418+0000 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:21.276418+0000 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:21.279 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.275+0000 7f0be0cf5640 1 Processor -- start 2024-04-09T12:05:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.275+0000 7f0be0cf5640 1 -- start start 2024-04-09T12:05:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.275+0000 7f0be0cf5640 10 monclient: init 2024-04-09T12:05:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 10 monclient: _add_conns ranks=[4,1,3,0,2] 2024-04-09T12:05:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0bdc0b44c0 0x7f0bdc13e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 10 monclient(hunting): picked mon.noname-c con 0x7f0bdc0b44c0 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0bdc13eb20 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0bdc1452e0 0x7f0bdc14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 10 monclient(hunting): picked mon.noname-a con 0x7f0bdc1452e0 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc0a9370 con 0x7f0bdc13eb20 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc0b48a0 con 0x7f0bdc1452e0 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc13ef40 con 0x7f0bdc0b44c0 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0be0cf5640 10 monclient(hunting): authenticate will time out at 1387.396136s 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0bdad9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0bdc1452e0 0x7f0bdc14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.276+0000 7f0bda59c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0bdc0b44c0 0x7f0bdc13e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bdad9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0bdc1452e0 0x7f0bdc14bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47946/0 (socket says 172.21.15.29:47946) 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bdad9d640 1 -- 172.21.15.29:0/3860015763 learned_addr learned my addr 172.21.15.29:0/3860015763 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bdad9d640 10 monclient(hunting): get_auth_request con 0x7f0bdc1452e0 auth_method 0 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bdad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bdad9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bdad9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bda59c640 10 monclient(hunting): get_auth_request con 0x7f0bdc0b44c0 auth_method 0 2024-04-09T12:05:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bda59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bda59c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bda59c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bdad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bdad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.277+0000 7f0bdad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.278+0000 7f0bda59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.278+0000 7f0bda59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.278+0000 7f0bda59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.279+0000 7f0bdad9d640 10 monclient(hunting): handle_auth_done global_id 4254 payload 274 2024-04-09T12:05:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.279+0000 7f0bdad9d640 1 -- 172.21.15.29:0/3860015763 >> v2:172.21.15.173:3300/0 conn(0x7f0bdc0b44c0 msgr2=0x7f0bdc13e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.279+0000 7f0bdad9d640 1 --2- 172.21.15.29:0/3860015763 >> v2:172.21.15.173:3300/0 conn(0x7f0bdc0b44c0 0x7f0bdc13e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.279+0000 7f0bdad9d640 1 -- 172.21.15.29:0/3860015763 >> v1:172.21.15.173:6789/0 conn(0x7f0bdc13eb20 legacy=0x7f0bdc144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.279+0000 7f0bdad9d640 10 monclient: _finish_hunting 0 2024-04-09T12:05:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.279+0000 7f0bdad9d640 1 monclient: found mon.noname-a 2024-04-09T12:05:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.279+0000 7f0bdad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.279+0000 7f0bdad9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:21.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.279+0000 7f0bdad9d640 1 -- 172.21.15.29:0/3860015763 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0aa4c0 con 0x7f0bdc1452e0 2024-04-09T12:05:21.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.281+0000 7f0bdad9d640 1 --2- 172.21.15.29:0/3860015763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bdc1452e0 0x7f0bdc14bf60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0b4220 tx=0x7f0bd402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4730bdf7054d9e05 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.283+0000 7f0bd9d9b640 1 -- 172.21.15.29:0/3860015763 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd402ca80 con 0x7f0bdc1452e0 2024-04-09T12:05:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.283+0000 7f0bd9d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.283+0000 7f0bd9d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.283+0000 7f0bd9d9b640 10 monclient: dump: 2024-04-09T12:05:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:21.287 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.283+0000 7f0bd9d9b640 10 monclient: _finish_auth 0 2024-04-09T12:05:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.283+0000 7f0bd9d9b640 10 monclient: _check_auth_tickets 2024-04-09T12:05:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.283+0000 7f0bd9d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.283+0000 7f0be0cf5640 5 monclient: authenticate success, global_id 4254 2024-04-09T12:05:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.283+0000 7f0be0cf5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:21.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.284+0000 7f0bd9d9b640 1 -- 172.21.15.29:0/3860015763 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd402cbe0 con 0x7f0bdc1452e0 2024-04-09T12:05:21.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.284+0000 7f0bd9d9b640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.284+0000 7f0bd9d9b640 1 -- 172.21.15.29:0/3860015763 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40343f0 con 0x7f0bdc1452e0 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.284+0000 7f0be0cf5640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.284+0000 7f0be0cf5640 4 set_mon_vals no callback set 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.284+0000 7f0bd9d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.284+0000 7f0bd9d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.284+0000 7f0bd9d9b640 10 monclient: dump: 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.285+0000 7f0be0cf5640 10 monclient: shutdown 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.285+0000 7f0be0cf5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.285+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3860015763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bdc1452e0 msgr2=0x7f0bdc14bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.285+0000 7f0be0cf5640 1 --2- 172.21.15.29:0/3860015763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bdc1452e0 0x7f0bdc14bf60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0b4220 tx=0x7f0bd402bee0 comp rx=0 tx=0).stop 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.285+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3860015763 shutdown_connections 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.285+0000 7f0be0cf5640 1 --2- 172.21.15.29:0/3860015763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bdc1452e0 0x7f0bdc14bf60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.285+0000 7f0be0cf5640 1 --2- 172.21.15.29:0/3860015763 >> v2:172.21.15.173:3300/0 conn(0x7f0bdc0b44c0 0x7f0bdc13e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.285+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3860015763 >> 172.21.15.29:0/3860015763 conn(0x7f0bdc065f30 msgr2=0x7f0bdc066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.285+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3860015763 shutdown_connections 2024-04-09T12:05:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.285+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3860015763 wait complete. 2024-04-09T12:05:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.286+0000 7f0be0cf5640 10 monclient: build_initial_monmap 2024-04-09T12:05:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.286+0000 7f0be0cf5640 10 monclient: monmap: 2024-04-09T12:05:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:21.292 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.286+0000 7f0be0cf5640 1 librados: starting msgr at 2024-04-09T12:05:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.286+0000 7f0be0cf5640 1 librados: starting objecter 2024-04-09T12:05:21.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.286+0000 7f0be0cf5640 1 Processor -- start 2024-04-09T12:05:21.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.286+0000 7f0be0cf5640 1 -- start start 2024-04-09T12:05:21.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.286+0000 7f0be0cf5640 1 librados: setting wanted keys 2024-04-09T12:05:21.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.286+0000 7f0be0cf5640 1 librados: calling monclient init 2024-04-09T12:05:21.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.286+0000 7f0be0cf5640 10 monclient: init 2024-04-09T12:05:21.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:21.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:05:21.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bdc0b44c0 0x7f0bdc0af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:21.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 10 monclient(hunting): picked mon.noname-b con 0x7f0bdc0b44c0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:21.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0bdc13eb20 0x7f0bdc0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 10 monclient(hunting): picked mon.noname-c con 0x7f0bdc13eb20 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bdc1452e0 0x7f0bdc1d6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 10 monclient(hunting): picked mon.noname-a con 0x7f0bdc1452e0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0b0bd0 con 0x7f0bdc1452e0 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0aea80 con 0x7f0bdc0b44c0 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc1d6810 con 0x7f0bdc13eb20 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0be0cf5640 10 monclient(hunting): authenticate will time out at 1387.407239s 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0bda59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bdc0b44c0 0x7f0bdc0af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.287+0000 7f0bdad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bdc1452e0 0x7f0bdc1d6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bd1d9b640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0bdc13eb20 0x7f0bdc0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bda59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bdc0b44c0 0x7f0bdc0af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:40936/0 (socket says 172.21.15.29:40936) 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bdad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bdc1452e0 0x7f0bdc1d6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47948/0 (socket says 172.21.15.29:47948) 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bda59c640 1 -- 172.21.15.29:0/3652971717 learned_addr learned my addr 172.21.15.29:0/3652971717 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bda59c640 10 monclient(hunting): get_auth_request con 0x7f0bdc0b44c0 auth_method 0 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bda59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bda59c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bda59c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bdad9d640 10 monclient(hunting): get_auth_request con 0x7f0bdc1452e0 auth_method 0 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bdad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bdad9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bdad9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bd1d9b640 10 monclient(hunting): get_auth_request con 0x7f0bdc13eb20 auth_method 0 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bd1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:21.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bd1d9b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bd1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bdad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bdad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bdad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bd1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bd1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bd1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bda59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bda59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.288+0000 7f0bda59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.291+0000 7f0bdad9d640 10 monclient(hunting): handle_auth_done global_id 4257 payload 824 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.291+0000 7f0bdad9d640 1 -- 172.21.15.29:0/3652971717 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0bdc13eb20 msgr2=0x7f0bdc0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.291+0000 7f0bdad9d640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0bdc13eb20 0x7f0bdc0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.291+0000 7f0bdad9d640 1 -- 172.21.15.29:0/3652971717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bdc0b44c0 msgr2=0x7f0bdc0af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.291+0000 7f0bdad9d640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bdc0b44c0 0x7f0bdc0af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.291+0000 7f0bdad9d640 10 monclient: _finish_hunting 0 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.291+0000 7f0bdad9d640 1 monclient: found mon.noname-a 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.291+0000 7f0bdad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.291+0000 7f0bdad9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.291+0000 7f0bdad9d640 1 -- 172.21.15.29:0/3652971717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4009b30 con 0x7f0bdc1452e0 2024-04-09T12:05:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.293+0000 7f0bdad9d640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bdc1452e0 0x7f0bdc1d6d30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4032000 tx=0x7f0bd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.293+0000 7f0bd37fe640 10 client.?.objecter ms_handle_connect 0x7f0bdc1452e0 2024-04-09T12:05:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.293+0000 7f0bd37fe640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 1 -- 172.21.15.29:0/3652971717 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4009510 con 0x7f0bdc1452e0 2024-04-09T12:05:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 10 monclient: dump: 2024-04-09T12:05:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:21.302 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 10 monclient: _finish_auth 0 2024-04-09T12:05:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 10 monclient: _check_auth_tickets 2024-04-09T12:05:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 1 -- 172.21.15.29:0/3652971717 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd403e450 con 0x7f0bdc1452e0 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 1 -- 172.21.15.29:0/3652971717 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd403e800 con 0x7f0bdc1452e0 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd37fe640 10 monclient: dump: 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0be0cf5640 5 monclient: authenticate success, global_id 4257 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0be0cf5640 10 monclient: _renew_subs 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0be0cf5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0bd959a640 4 set_mon_vals no callback set 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3652971717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc0b0db0 con 0x7f0bdc1452e0 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0be0cf5640 10 client.4257.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0be0cf5640 10 monclient: _renew_subs 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0be0cf5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3652971717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc0aced0 con 0x7f0bdc1452e0 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.297+0000 7f0be0cf5640 1 librados: init done 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.298+0000 7f0be0cf5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.298+0000 7f0be0cf5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:21.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.298+0000 7f0be0cf5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:21.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.298+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3652971717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc0a9c60 con 0x7f0bdc1452e0 2024-04-09T12:05:21.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.567+0000 7f0bd37fe640 1 -- 172.21.15.29:0/3652971717 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0bd402cd50 con 0x7f0bdc1452e0 2024-04-09T12:05:21.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.568+0000 7f0bd37fe640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0bbc06c5e0 0x7f0bbc06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:21.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.568+0000 7f0bda59c640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0bbc06c5e0 0x7f0bbc06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:21.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.568+0000 7f0bda59c640 10 monclient: get_auth_request con 0x7f0bbc06c5e0 auth_method 0 2024-04-09T12:05:21.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.569+0000 7f0bd37fe640 10 client.4257.objecter ms_handle_connect 0x7f0bbc06c5e0 2024-04-09T12:05:21.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.569+0000 7f0bda59c640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0bbc06c5e0 0x7f0bbc06eaa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009b60 tx=0x7f0bcc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:21.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.586+0000 7f0bd37fe640 1 -- 172.21.15.29:0/3652971717 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f0bd407af90 con 0x7f0bdc1452e0 2024-04-09T12:05:21.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.586+0000 7f0bd37fe640 10 client.4257.objecter ms_dispatch 0x7f0bdc000b90 osd_map(23..23 src has 1..23) v4 2024-04-09T12:05:21.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.586+0000 7f0bd37fe640 3 client.4257.objecter handle_osd_map got epochs [23,23] > 0 2024-04-09T12:05:21.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.586+0000 7f0bd37fe640 3 client.4257.objecter handle_osd_map decoding full epoch 23 2024-04-09T12:05:21.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.586+0000 7f0bd37fe640 20 client.4257.objecter dump_active .. 0 homeless 2024-04-09T12:05:21.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.586+0000 7f0bd37fe640 1 -- 172.21.15.29:0/3652971717 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f0bd40772d0 con 0x7f0bdc1452e0 2024-04-09T12:05:21.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.586+0000 7f0bd37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:21.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.586+0000 7f0bd37fe640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:21.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.778+0000 7f0be0cf5640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-04-09T12:05:21.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.778+0000 7f0be0cf5640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-04-09T12:05:21.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.778+0000 7f0be0cf5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:21.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:21.778+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3652971717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0bdc04e1d0 con 0x7f0bdc1452e0 2024-04-09T12:05:22.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.163+0000 7f0bd37fe640 1 -- 172.21.15.29:0/3652971717 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v24) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0bd407a8f0 con 0x7f0bdc1452e0 2024-04-09T12:05:22.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.163+0000 7f0bd37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-04-09T12:05:22.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.163+0000 7f0bd37fe640 10 monclient: _finish_command 2 = system:0 enabled application 'rbd' on pool 'rbd' 2024-04-09T12:05:22.166 INFO:teuthology.orchestra.run.smithi029.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-09T12:05:22.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.165+0000 7f0be0cf5640 10 librados: watch_flush enter 2024-04-09T12:05:22.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.165+0000 7f0be0cf5640 10 librados: watch_flush exit 2024-04-09T12:05:22.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.165+0000 7f0be0cf5640 20 client.4257.objecter shutdown clearing up homeless session... 2024-04-09T12:05:22.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.165+0000 7f0be0cf5640 10 client.4257.objecter successfully canceled tick 2024-04-09T12:05:22.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3652971717 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0bbc06c5e0 msgr2=0x7f0bbc06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:22.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0bbc06c5e0 0x7f0bbc06eaa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009b60 tx=0x7f0bcc009190 comp rx=0 tx=0).stop 2024-04-09T12:05:22.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 10 monclient: shutdown 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3652971717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bdc1452e0 msgr2=0x7f0bdc1d6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bdc1452e0 0x7f0bdc1d6d30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4032000 tx=0x7f0bd4004a40 comp rx=0 tx=0).stop 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3652971717 shutdown_connections 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0bbc06c5e0 0x7f0bbc06eaa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bdc1452e0 0x7f0bdc1d6d30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0bdc13eb20 0x7f0bdc0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 --2- 172.21.15.29:0/3652971717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bdc0b44c0 0x7f0bdc0af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3652971717 >> 172.21.15.29:0/3652971717 conn(0x7f0bdc065f30 msgr2=0x7f0bdc066310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3652971717 shutdown_connections 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 -- 172.21.15.29:0/3652971717 wait complete. 2024-04-09T12:05:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.166+0000 7f0be0cf5640 1 librados: shutdown 2024-04-09T12:05:22.180 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-09T12:05:22.181 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-09T12:05:22.181 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-09T12:05:22.181 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-09T12:05:22.182 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-09T12:05:22.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.289+0000 7f15338dc640 10 monclient: get_monmap_and_config 2024-04-09T12:05:22.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.289+0000 7f15338dc640 10 monclient: build_initial_monmap 2024-04-09T12:05:22.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.289+0000 7f15338dc640 10 monclient: monmap: 2024-04-09T12:05:22.292 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:22.292 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:22.292 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:22.290807+0000 2024-04-09T12:05:22.292 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:22.290807+0000 2024-04-09T12:05:22.292 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:22.292 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:22.293 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:22.293 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:22.293 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:22.293 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:22.293 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:22.293 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.289+0000 7f15338dc640 1 Processor -- start 2024-04-09T12:05:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 1 -- start start 2024-04-09T12:05:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 10 monclient: init 2024-04-09T12:05:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 10 monclient: _add_conns ranks=[3,2,1,0,4] 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f152c0addf0 0x7f152c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 10 monclient(hunting): picked mon.noname-a con 0x7f152c0addf0 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c06fef0 0x7f152c13bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 10 monclient(hunting): picked mon.noname-b con 0x7f152c06fef0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f152c071650 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c06fb30 con 0x7f152c071650 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c0ae1d0 con 0x7f152c0addf0 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c06ed30 con 0x7f152c06fef0 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.290+0000 7f15338dc640 10 monclient(hunting): authenticate will time out at 1388.410665s 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1531678640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f152c0addf0 0x7f152c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1530e77640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c06fef0 0x7f152c13bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1531678640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f152c0addf0 0x7f152c13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47954/0 (socket says 172.21.15.29:47954) 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1531678640 1 -- 172.21.15.29:0/2644028368 learned_addr learned my addr 172.21.15.29:0/2644028368 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1531678640 10 monclient(hunting): get_auth_request con 0x7f152c0addf0 auth_method 0 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1531678640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1531678640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1531678640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1530e77640 10 monclient(hunting): get_auth_request con 0x7f152c06fef0 auth_method 0 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1530e77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1530e77640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.291+0000 7f1530e77640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.292+0000 7f1531678640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.292+0000 7f1531678640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.292+0000 7f1531678640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.292+0000 7f1530e77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.292+0000 7f1530e77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.292+0000 7f1530e77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.294+0000 7f1531678640 10 monclient(hunting): handle_auth_done global_id 4260 payload 274 2024-04-09T12:05:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.294+0000 7f1531678640 1 -- 172.21.15.29:0/2644028368 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c06fef0 msgr2=0x7f152c13bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.294+0000 7f1531678640 1 --2- 172.21.15.29:0/2644028368 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c06fef0 0x7f152c13bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.294+0000 7f1531678640 1 -- 172.21.15.29:0/2644028368 >> v1:172.21.15.173:6789/0 conn(0x7f152c071650 legacy=0x7f152c071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.294+0000 7f1531678640 10 monclient: _finish_hunting 0 2024-04-09T12:05:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.294+0000 7f1531678640 1 monclient: found mon.noname-a 2024-04-09T12:05:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.294+0000 7f1531678640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.294+0000 7f1531678640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.294+0000 7f1531678640 1 -- 172.21.15.29:0/2644028368 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0af7f0 con 0x7f152c0addf0 2024-04-09T12:05:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.294+0000 7f1530e77640 1 --2- 172.21.15.29:0/2644028368 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c06fef0 0x7f152c13bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-09T12:05:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.296+0000 7f1531678640 1 --2- 172.21.15.29:0/2644028368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f152c0addf0 0x7f152c13b630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1528009870 tx=0x7f152802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe78114c7f92fcc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:22.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 1 -- 172.21.15.29:0/2644028368 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528031640 con 0x7f152c0addf0 2024-04-09T12:05:22.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:22.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:22.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 10 monclient: dump: 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 10 monclient: _finish_auth 0 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 10 monclient: _check_auth_tickets 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 1 -- 172.21.15.29:0/2644028368 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15280317a0 con 0x7f152c0addf0 2024-04-09T12:05:22.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 1 -- 172.21.15.29:0/2644028368 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528031b30 con 0x7f152c0addf0 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f15338dc640 5 monclient: authenticate success, global_id 4260 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f15338dc640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f15338dc640 4 set_mon_vals no callback set 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f151ffff640 10 monclient: dump: 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f15338dc640 10 monclient: shutdown 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f15338dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f15338dc640 1 -- 172.21.15.29:0/2644028368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f152c0addf0 msgr2=0x7f152c13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f15338dc640 1 --2- 172.21.15.29:0/2644028368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f152c0addf0 0x7f152c13b630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1528009870 tx=0x7f152802b8f0 comp rx=0 tx=0).stop 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f15338dc640 1 -- 172.21.15.29:0/2644028368 shutdown_connections 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f15338dc640 1 --2- 172.21.15.29:0/2644028368 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c06fef0 0x7f152c13bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f15338dc640 1 --2- 172.21.15.29:0/2644028368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f152c0addf0 0x7f152c13b630 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.301+0000 7f15338dc640 1 -- 172.21.15.29:0/2644028368 >> 172.21.15.29:0/2644028368 conn(0x7f152c0b3120 msgr2=0x7f152c0b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.302+0000 7f15338dc640 1 -- 172.21.15.29:0/2644028368 shutdown_connections 2024-04-09T12:05:22.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.302+0000 7f15338dc640 1 -- 172.21.15.29:0/2644028368 wait complete. 2024-04-09T12:05:22.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.302+0000 7f15338dc640 10 monclient: build_initial_monmap 2024-04-09T12:05:22.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.302+0000 7f15338dc640 10 monclient: monmap: 2024-04-09T12:05:22.310 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:22.310 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:22.310 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:22.310 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:22.310 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.302+0000 7f15338dc640 1 librados: starting msgr at 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.302+0000 7f15338dc640 1 librados: starting objecter 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 1 Processor -- start 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 1 -- start start 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 1 librados: setting wanted keys 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 1 librados: calling monclient init 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 10 monclient: init 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:22.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f152c06fef0 0x7f152c13efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 10 monclient(hunting): picked mon.noname-a con 0x7f152c06fef0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c071650 0x7f152c13fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 10 monclient(hunting): picked mon.noname-c con 0x7f152c071650 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f152c0addf0 0x7f152c136190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 10 monclient(hunting): picked mon.noname-b con 0x7f152c0addf0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c1d9ea0 con 0x7f152c06fef0 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c140240 con 0x7f152c0addf0 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c13e3f0 con 0x7f152c071650 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:22.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.303+0000 7f15338dc640 10 monclient(hunting): authenticate will time out at 1388.423858s 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1530e77640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c071650 0x7f152c13fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1531e79640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f152c0addf0 0x7f152c136190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1530e77640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c071650 0x7f152c13fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39182/0 (socket says 172.21.15.29:39182) 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1530e77640 1 -- 172.21.15.29:0/1205528706 learned_addr learned my addr 172.21.15.29:0/1205528706 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1530e77640 10 monclient(hunting): get_auth_request con 0x7f152c071650 auth_method 0 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1530e77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1530e77640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1530e77640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1531e79640 10 monclient(hunting): get_auth_request con 0x7f152c0addf0 auth_method 0 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1531e79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1531e79640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.304+0000 7f1531e79640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.305+0000 7f1531e79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:22.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.305+0000 7f1531e79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:22.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.305+0000 7f1531e79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:22.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.305+0000 7f1530e77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:22.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.305+0000 7f1530e77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:22.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.305+0000 7f1530e77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:22.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.307+0000 7f1531678640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f152c06fef0 0x7f152c13efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531678640 10 monclient(hunting): get_auth_request con 0x7f152c06fef0 auth_method 0 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531678640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531678640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531678640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531e79640 10 monclient(hunting): handle_auth_done global_id 4318 payload 824 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531e79640 1 -- 172.21.15.29:0/1205528706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c071650 msgr2=0x7f152c13fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531e79640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c071650 0x7f152c13fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531e79640 1 -- 172.21.15.29:0/1205528706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f152c06fef0 msgr2=0x7f152c13efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531e79640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f152c06fef0 0x7f152c13efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531e79640 10 monclient: _finish_hunting 0 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531e79640 1 monclient: found mon.noname-b 2024-04-09T12:05:22.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531e79640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:22.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531e79640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:22.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.308+0000 7f1531e79640 1 -- 172.21.15.29:0/1205528706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1520009400 con 0x7f152c0addf0 2024-04-09T12:05:22.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.310+0000 7f1531e79640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f152c0addf0 0x7f152c136190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f152400c690 tx=0x7f152400cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:22.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.310+0000 7f151dffb640 10 client.?.objecter ms_handle_connect 0x7f152c0addf0 2024-04-09T12:05:22.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.310+0000 7f151dffb640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:22.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 1 -- 172.21.15.29:0/1205528706 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524003b70 con 0x7f152c0addf0 2024-04-09T12:05:22.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:22.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:22.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 10 monclient: dump: 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 10 monclient: _finish_auth 0 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 10 monclient: _check_auth_tickets 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:22.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 1 -- 172.21.15.29:0/1205528706 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1524003cd0 con 0x7f152c0addf0 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 1 -- 172.21.15.29:0/1205528706 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524005310 con 0x7f152c0addf0 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151dffb640 10 monclient: dump: 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:22.319 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:22.320 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f15338dc640 5 monclient: authenticate success, global_id 4318 2024-04-09T12:05:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f15338dc640 10 monclient: _renew_subs 2024-04-09T12:05:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f151f7fe640 4 set_mon_vals no callback set 2024-04-09T12:05:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f15338dc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f15338dc640 1 -- 172.21.15.29:0/1205528706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15280094d0 con 0x7f152c0addf0 2024-04-09T12:05:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f15338dc640 10 client.4318.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f15338dc640 10 monclient: _renew_subs 2024-04-09T12:05:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f15338dc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f15338dc640 1 -- 172.21.15.29:0/1205528706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c146e50 con 0x7f152c0addf0 2024-04-09T12:05:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.314+0000 7f15338dc640 1 librados: init done 2024-04-09T12:05:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.315+0000 7f15338dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.315+0000 7f15338dc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.315+0000 7f15338dc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.315+0000 7f15338dc640 1 -- 172.21.15.29:0/1205528706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c04e160 con 0x7f152c0addf0 2024-04-09T12:05:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.333+0000 7f151dffb640 1 -- 172.21.15.29:0/1205528706 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1524005470 con 0x7f152c0addf0 2024-04-09T12:05:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.333+0000 7f151dffb640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f151006c5e0 0x7f151006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.334+0000 7f1531678640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f151006c5e0 0x7f151006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.334+0000 7f1531678640 10 monclient: get_auth_request con 0x7f151006c5e0 auth_method 0 2024-04-09T12:05:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.334+0000 7f1531678640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f151006c5e0 0x7f151006eaa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1528036000 tx=0x7f152803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.334+0000 7f151dffb640 10 client.4318.objecter ms_handle_connect 0x7f151006c5e0 2024-04-09T12:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.337+0000 7f151dffb640 1 -- 172.21.15.29:0/1205528706 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1524059070 con 0x7f152c0addf0 2024-04-09T12:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.337+0000 7f151dffb640 10 client.4318.objecter ms_dispatch 0x7f152c000b90 osd_map(24..24 src has 1..24) v4 2024-04-09T12:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.337+0000 7f151dffb640 3 client.4318.objecter handle_osd_map got epochs [24,24] > 0 2024-04-09T12:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.337+0000 7f151dffb640 3 client.4318.objecter handle_osd_map decoding full epoch 24 2024-04-09T12:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.337+0000 7f151dffb640 20 client.4318.objecter dump_active .. 0 homeless 2024-04-09T12:05:22.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.616+0000 7f151dffb640 1 -- 172.21.15.29:0/1205528706 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f1524054cb0 con 0x7f152c0addf0 2024-04-09T12:05:22.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.616+0000 7f151dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:22.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.616+0000 7f151dffb640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:22.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.858+0000 7f15338dc640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2024-04-09T12:05:22.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.858+0000 7f15338dc640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2024-04-09T12:05:22.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.858+0000 7f15338dc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:22.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.858+0000 7f15338dc640 1 -- 172.21.15.29:0/1205528706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f152c138ce0 con 0x7f152c0addf0 2024-04-09T12:05:23.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.997+0000 7f151dffb640 1 -- 172.21.15.29:0/1205528706 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170944 (secure 0 0 0) 0x7f15240582d0 con 0x7f152c0addf0 2024-04-09T12:05:23.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.997+0000 7f151dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2024-04-09T12:05:23.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.997+0000 7f151dffb640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:23.003 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:05:23.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.999+0000 7f15338dc640 10 librados: watch_flush enter 2024-04-09T12:05:23.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.999+0000 7f15338dc640 10 librados: watch_flush exit 2024-04-09T12:05:23.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.999+0000 7f15338dc640 20 client.4318.objecter shutdown clearing up homeless session... 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.999+0000 7f15338dc640 10 client.4318.objecter successfully canceled tick 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.999+0000 7f15338dc640 1 -- 172.21.15.29:0/1205528706 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f151006c5e0 msgr2=0x7f151006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.999+0000 7f15338dc640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f151006c5e0 0x7f151006eaa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1528036000 tx=0x7f152803c040 comp rx=0 tx=0).stop 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.999+0000 7f15338dc640 10 monclient: shutdown 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.999+0000 7f15338dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.999+0000 7f15338dc640 1 -- 172.21.15.29:0/1205528706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f152c0addf0 msgr2=0x7f152c136190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:22.999+0000 7f15338dc640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f152c0addf0 0x7f152c136190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f152400c690 tx=0x7f152400cb50 comp rx=0 tx=0).stop 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.000+0000 7f15338dc640 1 -- 172.21.15.29:0/1205528706 shutdown_connections 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.000+0000 7f15338dc640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f151006c5e0 0x7f151006eaa0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.000+0000 7f15338dc640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f152c0addf0 0x7f152c136190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.000+0000 7f15338dc640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f152c071650 0x7f152c13fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.000+0000 7f15338dc640 1 --2- 172.21.15.29:0/1205528706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f152c06fef0 0x7f152c13efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.000+0000 7f15338dc640 1 -- 172.21.15.29:0/1205528706 >> 172.21.15.29:0/1205528706 conn(0x7f152c0b3120 msgr2=0x7f152c141a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:23.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.000+0000 7f15338dc640 1 -- 172.21.15.29:0/1205528706 shutdown_connections 2024-04-09T12:05:23.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.000+0000 7f15338dc640 1 -- 172.21.15.29:0/1205528706 wait complete. 2024-04-09T12:05:23.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.000+0000 7f15338dc640 1 librados: shutdown 2024-04-09T12:05:23.014 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":34987},{"type":"v1","addr":"172.21.15.173:6801","nonce":34987}]},"active_addr":"172.21.15.173:6801/34987","active_change":"2024-04-09T12:04:23.775630+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":3026672711}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":1607467124}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":1402470200}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":2543729991}]}]} 2024-04-09T12:05:23.021 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-09T12:05:23.021 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-09T12:05:23.021 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-09T12:05:23.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.124+0000 7f2d7242a640 10 monclient: get_monmap_and_config 2024-04-09T12:05:23.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.124+0000 7f2d7242a640 10 monclient: build_initial_monmap 2024-04-09T12:05:23.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.124+0000 7f2d7242a640 10 monclient: monmap: 2024-04-09T12:05:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:23.126327+0000 2024-04-09T12:05:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:23.126327+0000 2024-04-09T12:05:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:23.129 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.125+0000 7f2d7242a640 1 Processor -- start 2024-04-09T12:05:23.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.125+0000 7f2d7242a640 1 -- start start 2024-04-09T12:05:23.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.125+0000 7f2d7242a640 10 monclient: init 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2d6c0b4420 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0a8830 0x7f2d6c0a9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 10 monclient(hunting): picked mon.noname-b con 0x7f2d6c0a8830 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2d6c13e650 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6c0aa430 con 0x7f2d6c13e650 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6c0aa710 con 0x7f2d6c0b4420 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0b4800 con 0x7f2d6c0a8830 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d7242a640 10 monclient(hunting): authenticate will time out at 1389.246204s 2024-04-09T12:05:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.126+0000 7f2d6b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0a8830 0x7f2d6c0a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.127+0000 7f2d6bfff640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f2d6c0b4420 0x7f2d6c144b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:46274/0 (socket says 172.21.15.29:46274) 2024-04-09T12:05:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.127+0000 7f2d6bfff640 1 -- 172.21.15.29:0/4265441508 learned_addr learned my addr 172.21.15.29:0/4265441508 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.127+0000 7f2d6b7fe640 10 monclient(hunting): get_auth_request con 0x7f2d6c0a8830 auth_method 0 2024-04-09T12:05:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.127+0000 7f2d6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.127+0000 7f2d6b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.127+0000 7f2d6b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.127+0000 7f2d6b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.127+0000 7f2d6b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.128+0000 7f2d6b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:23.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.130+0000 7f2d6b7fe640 10 monclient(hunting): handle_auth_done global_id 4247 payload 274 2024-04-09T12:05:23.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.130+0000 7f2d6b7fe640 1 -- 172.21.15.29:0/4265441508 >> v1:172.21.15.173:6789/0 conn(0x7f2d6c0b4420 legacy=0x7f2d6c144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.130+0000 7f2d6b7fe640 1 -- 172.21.15.29:0/4265441508 >> v1:172.21.15.29:6789/0 conn(0x7f2d6c13e650 legacy=0x7f2d6c14bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:23.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.130+0000 7f2d6b7fe640 10 monclient: _finish_hunting 0 2024-04-09T12:05:23.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.130+0000 7f2d6b7fe640 1 monclient: found mon.noname-b 2024-04-09T12:05:23.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.130+0000 7f2d6b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:23.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.130+0000 7f2d6b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:23.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.130+0000 7f2d6b7fe640 1 -- 172.21.15.29:0/4265441508 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c0a8d50 con 0x7f2d6c0a8830 2024-04-09T12:05:23.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.132+0000 7f2d6b7fe640 1 --2- 172.21.15.29:0/4265441508 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0a8830 0x7f2d6c0a9270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0097d0 tx=0x7f2d5c02b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e91d8c3d015181e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:23.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 1 -- 172.21.15.29:0/4265441508 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c031770 con 0x7f2d6c0a8830 2024-04-09T12:05:23.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:23.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:23.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 10 monclient: dump: 2024-04-09T12:05:23.140 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:23.140 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:23.140 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.140 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.140 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:23.140 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 10 monclient: _finish_auth 0 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 1 -- 172.21.15.29:0/4265441508 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c0318d0 con 0x7f2d6c0a8830 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 5 monclient: authenticate success, global_id 4247 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:23.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 1 -- 172.21.15.29:0/4265441508 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c031c60 con 0x7f2d6c0a8830 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 4 set_mon_vals no callback set 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d6affd640 10 monclient: dump: 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:23.142 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:23.143 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:23.143 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 10 monclient: shutdown 2024-04-09T12:05:23.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:23.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 1 -- 172.21.15.29:0/4265441508 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0a8830 msgr2=0x7f2d6c0a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 1 --2- 172.21.15.29:0/4265441508 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0a8830 0x7f2d6c0a9270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0097d0 tx=0x7f2d5c02b810 comp rx=0 tx=0).stop 2024-04-09T12:05:23.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 1 -- 172.21.15.29:0/4265441508 shutdown_connections 2024-04-09T12:05:23.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 1 --2- 172.21.15.29:0/4265441508 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0a8830 0x7f2d6c0a9270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 1 -- 172.21.15.29:0/4265441508 >> 172.21.15.29:0/4265441508 conn(0x7f2d6c065f00 msgr2=0x7f2d6c066310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:23.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.137+0000 7f2d7242a640 1 -- 172.21.15.29:0/4265441508 shutdown_connections 2024-04-09T12:05:23.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.138+0000 7f2d7242a640 1 -- 172.21.15.29:0/4265441508 wait complete. 2024-04-09T12:05:23.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.138+0000 7f2d7242a640 10 monclient: build_initial_monmap 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.138+0000 7f2d7242a640 10 monclient: monmap: 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.138+0000 7f2d7242a640 1 librados: starting msgr at 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.138+0000 7f2d7242a640 1 librados: starting objecter 2024-04-09T12:05:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 1 Processor -- start 2024-04-09T12:05:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 1 -- start start 2024-04-09T12:05:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 1 librados: setting wanted keys 2024-04-09T12:05:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 1 librados: calling monclient init 2024-04-09T12:05:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 10 monclient: init 2024-04-09T12:05:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-09T12:05:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d6c0a8830 0x7f2d6c0ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 10 monclient(hunting): picked mon.noname-a con 0x7f2d6c0a8830 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0b4420 0x7f2d6c0ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 10 monclient(hunting): picked mon.noname-c con 0x7f2d6c0b4420 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d6c13e650 0x7f2d6c140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 10 monclient(hunting): picked mon.noname-b con 0x7f2d6c13e650 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0ac6e0 con 0x7f2d6c0a8830 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0adb90 con 0x7f2d6c13e650 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0ade00 con 0x7f2d6c0b4420 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.139+0000 7f2d7242a640 10 monclient(hunting): authenticate will time out at 1389.259814s 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d6b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0b4420 0x7f2d6c0ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d709c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d6c13e650 0x7f2d6c140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d6b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0b4420 0x7f2d6c0ac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39194/0 (socket says 172.21.15.29:39194) 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d709c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d6c13e650 0x7f2d6c140c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:40942/0 (socket says 172.21.15.29:40942) 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d6b7fe640 1 -- 172.21.15.29:0/3580222773 learned_addr learned my addr 172.21.15.29:0/3580222773 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d6b7fe640 10 monclient(hunting): get_auth_request con 0x7f2d6c0b4420 auth_method 0 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d6b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d6b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d709c7640 10 monclient(hunting): get_auth_request con 0x7f2d6c13e650 auth_method 0 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d709c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d709c7640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.140+0000 7f2d709c7640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.141+0000 7f2d709c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.141+0000 7f2d709c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.141+0000 7f2d709c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.141+0000 7f2d6b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.141+0000 7f2d6b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.141+0000 7f2d6b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.144+0000 7f2d709c7640 10 monclient(hunting): handle_auth_done global_id 4321 payload 824 2024-04-09T12:05:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.144+0000 7f2d709c7640 1 -- 172.21.15.29:0/3580222773 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0b4420 msgr2=0x7f2d6c0ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.144+0000 7f2d709c7640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0b4420 0x7f2d6c0ac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.144+0000 7f2d709c7640 1 -- 172.21.15.29:0/3580222773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d6c0a8830 msgr2=0x7f2d6c0ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.144+0000 7f2d709c7640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d6c0a8830 0x7f2d6c0ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.144+0000 7f2d709c7640 10 monclient: _finish_hunting 0 2024-04-09T12:05:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.144+0000 7f2d709c7640 1 monclient: found mon.noname-b 2024-04-09T12:05:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.144+0000 7f2d709c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.144+0000 7f2d709c7640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.144+0000 7f2d709c7640 1 -- 172.21.15.29:0/3580222773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c009400 con 0x7f2d6c13e650 2024-04-09T12:05:23.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.146+0000 7f2d709c7640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d6c13e650 0x7f2d6c140c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400be20 tx=0x7f2d6400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:23.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.146+0000 7f2d68ff9640 10 client.?.objecter ms_handle_connect 0x7f2d6c13e650 2024-04-09T12:05:23.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.146+0000 7f2d68ff9640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 1 -- 172.21.15.29:0/3580222773 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400ce70 con 0x7f2d6c13e650 2024-04-09T12:05:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 10 monclient: dump: 2024-04-09T12:05:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 10 monclient: _finish_auth 0 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 10 monclient: _check_auth_tickets 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 1 -- 172.21.15.29:0/3580222773 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d64014440 con 0x7f2d6c13e650 2024-04-09T12:05:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d7242a640 5 monclient: authenticate success, global_id 4321 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d7242a640 10 monclient: _renew_subs 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d7242a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d7242a640 1 -- 172.21.15.29:0/3580222773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c0b18d0 con 0x7f2d6c13e650 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 1 -- 172.21.15.29:0/3580222773 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d640147f0 con 0x7f2d6c13e650 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d68ff9640 10 monclient: dump: 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d6a7fc640 4 set_mon_vals no callback set 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d7242a640 10 client.4321.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d7242a640 10 monclient: _renew_subs 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d7242a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d7242a640 1 -- 172.21.15.29:0/3580222773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c0acb70 con 0x7f2d6c13e650 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.150+0000 7f2d7242a640 1 librados: init done 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.151+0000 7f2d7242a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.151+0000 7f2d7242a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.151+0000 7f2d7242a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.151+0000 7f2d7242a640 1 -- 172.21.15.29:0/3580222773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6c04e160 con 0x7f2d6c13e650 2024-04-09T12:05:23.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.172+0000 7f2d68ff9640 1 -- 172.21.15.29:0/3580222773 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2d6401d3b0 con 0x7f2d6c13e650 2024-04-09T12:05:23.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.172+0000 7f2d68ff9640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f2d4c06c5e0 0x7f2d4c06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:23.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.172+0000 7f2d6bfff640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f2d4c06c5e0 0x7f2d4c06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:23.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.172+0000 7f2d6bfff640 10 monclient: get_auth_request con 0x7f2d4c06c5e0 auth_method 0 2024-04-09T12:05:23.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.173+0000 7f2d68ff9640 10 client.4321.objecter ms_handle_connect 0x7f2d4c06c5e0 2024-04-09T12:05:23.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.173+0000 7f2d6bfff640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f2d4c06c5e0 0x7f2d4c06eaa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d540015f0 tx=0x7f2d54007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:23.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.175+0000 7f2d68ff9640 1 -- 172.21.15.29:0/3580222773 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2d64058870 con 0x7f2d6c13e650 2024-04-09T12:05:23.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.175+0000 7f2d68ff9640 10 client.4321.objecter ms_dispatch 0x7f2d6c000b90 osd_map(24..24 src has 1..24) v4 2024-04-09T12:05:23.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.175+0000 7f2d68ff9640 3 client.4321.objecter handle_osd_map got epochs [24,24] > 0 2024-04-09T12:05:23.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.175+0000 7f2d68ff9640 3 client.4321.objecter handle_osd_map decoding full epoch 24 2024-04-09T12:05:23.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.175+0000 7f2d68ff9640 20 client.4321.objecter dump_active .. 0 homeless 2024-04-09T12:05:23.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.413+0000 7f2d68ff9640 1 -- 172.21.15.29:0/3580222773 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f2d64054bb0 con 0x7f2d6c13e650 2024-04-09T12:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.413+0000 7f2d68ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.413+0000 7f2d68ff9640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:23.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.600+0000 7f2d7242a640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:23.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.600+0000 7f2d7242a640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:23.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.600+0000 7f2d7242a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:23.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.600+0000 7f2d7242a640 1 -- 172.21.15.29:0/3580222773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d6c0ac890 con 0x7f2d6c13e650 2024-04-09T12:05:23.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.695+0000 7f2d68ff9640 1 -- 172.21.15.29:0/3580222773 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14194 (secure 0 0 0) 0x7f2d6c0ac890 con 0x7f2d6c13e650 2024-04-09T12:05:23.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.695+0000 7f2d68ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:23.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.695+0000 7f2d68ff9640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:23.699 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:05:23.699 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"1673ebad-34a7-414e-b498-c4f5250b317b","created":"2024-04-09T12:04:18.271948+0000","modified":"2024-04-09T12:05:23.209773+0000","last_up_change":"2024-04-09T12:05:15.358605+0000","last_in_change":"2024-04-09T12:04:23.695144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-09T12:05:04.691771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-09T12:05:20.460989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c929787-7de5-4d2f-9b36-3a165fa73386","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":35238},{"type":"v1","addr":"172.21.15.29:6809","nonce":35238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":35238},{"type":"v1","addr":"172.21.15.29:6811","nonce":35238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":35238},{"type":"v1","addr":"172.21.15.29:6815","nonce":35238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":35238},{"type":"v1","addr":"172.21.15.29:6813","nonce":35238}]},"public_addr":"172.21.15.29:6809/35238","cluster_addr":"172.21.15.29:6811/35238","heartbeat_back_addr":"172.21.15.29:6815/35238","heartbeat_front_addr":"172.21.15.29:6813/35238","state":["exists","up"]},{"osd":1,"uuid":"54d0b5c7-3415-4585-8a9b-c67a8ae94ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":35236},{"type":"v1","addr":"172.21.15.29:6825","nonce":35236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":35236},{"type":"v1","addr":"172.21.15.29:6827","nonce":35236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":35236},{"type":"v1","addr":"172.21.15.29:6831","nonce":35236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":35236},{"type":"v1","addr":"172.21.15.29:6829","nonce":35236}]},"public_addr":"172.21.15.29:6825/35236","cluster_addr":"172.21.15.29:6827/35236","heartbeat_back_addr":"172.21.15.29:6831/35236","heartbeat_front_addr":"172.21.15.29:6829/35236","state":["exists","up"]},{"osd":2,"uuid":"7a343481-8465-4e19-989c-4a62c926338c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":35237},{"type":"v1","addr":"172.21.15.29:6801","nonce":35237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":35237},{"type":"v1","addr":"172.21.15.29:6803","nonce":35237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":35237},{"type":"v1","addr":"172.21.15.29:6807","nonce":35237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":35237},{"type":"v1","addr":"172.21.15.29:6805","nonce":35237}]},"public_addr":"172.21.15.29:6801/35237","cluster_addr":"172.21.15.29:6803/35237","heartbeat_back_addr":"172.21.15.29:6807/35237","heartbeat_front_addr":"172.21.15.29:6805/35237","state":["exists","up"]},{"osd":3,"uuid":"7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":35239},{"type":"v1","addr":"172.21.15.29:6817","nonce":35239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":35239},{"type":"v1","addr":"172.21.15.29:6819","nonce":35239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":35239},{"type":"v1","addr":"172.21.15.29:6823","nonce":35239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":35239},{"type":"v1","addr":"172.21.15.29:6821","nonce":35239}]},"public_addr":"172.21.15.29:6817/35239","cluster_addr":"172.21.15.29:6819/35239","heartbeat_back_addr":"172.21.15.29:6823/35239","heartbeat_front_addr":"172.21.15.29:6821/35239","state":["exists","up"]},{"osd":4,"uuid":"7f553202-73e9-496c-893f-185c61f66807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":35529},{"type":"v1","addr":"172.21.15.173:6819","nonce":35529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":35529},{"type":"v1","addr":"172.21.15.173:6821","nonce":35529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6825","nonce":35529},{"type":"v1","addr":"172.21.15.173:6827","nonce":35529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":35529},{"type":"v1","addr":"172.21.15.173:6824","nonce":35529}]},"public_addr":"172.21.15.173:6819/35529","cluster_addr":"172.21.15.173:6821/35529","heartbeat_back_addr":"172.21.15.173:6827/35529","heartbeat_front_addr":"172.21.15.173:6824/35529","state":["exists","up"]},{"osd":5,"uuid":"84050623-d3f3-40ba-b63e-92d56a74bfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":35531},{"type":"v1","addr":"172.21.15.173:6826","nonce":35531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":35531},{"type":"v1","addr":"172.21.15.173:6829","nonce":35531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":35531},{"type":"v1","addr":"172.21.15.173:6833","nonce":35531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":35531},{"type":"v1","addr":"172.21.15.173:6831","nonce":35531}]},"public_addr":"172.21.15.173:6826/35531","cluster_addr":"172.21.15.173:6829/35531","heartbeat_back_addr":"172.21.15.173:6833/35531","heartbeat_front_addr":"172.21.15.173:6831/35531","state":["exists","up"]},{"osd":6,"uuid":"883e841f-8acc-4268-8e64-c556b10befa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":35530},{"type":"v1","addr":"172.21.15.173:6803","nonce":35530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":35530},{"type":"v1","addr":"172.21.15.173:6805","nonce":35530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":35530},{"type":"v1","addr":"172.21.15.173:6809","nonce":35530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":35530},{"type":"v1","addr":"172.21.15.173:6807","nonce":35530}]},"public_addr":"172.21.15.173:6803/35530","cluster_addr":"172.21.15.173:6805/35530","heartbeat_back_addr":"172.21.15.173:6809/35530","heartbeat_front_addr":"172.21.15.173:6807/35530","state":["exists","up"]},{"osd":7,"uuid":"126085be-23ad-45b6-951d-47886bdfa75c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":35532},{"type":"v1","addr":"172.21.15.173:6811","nonce":35532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":35532},{"type":"v1","addr":"172.21.15.173:6813","nonce":35532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":35532},{"type":"v1","addr":"172.21.15.173:6817","nonce":35532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":35532},{"type":"v1","addr":"172.21.15.173:6815","nonce":35532}]},"public_addr":"172.21.15.173:6811/35532","cluster_addr":"172.21.15.173:6813/35532","heartbeat_back_addr":"172.21.15.173:6817/35532","heartbeat_front_addr":"172.21.15.173:6815/35532","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:01.923058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:03.497855+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:02.626090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:02.816164+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:01.755586+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:00.598310+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:00.974235+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:01.169040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-09T12:05:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 10 librados: watch_flush enter 2024-04-09T12:05:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 10 librados: watch_flush exit 2024-04-09T12:05:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 20 client.4321.objecter shutdown clearing up homeless session... 2024-04-09T12:05:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 10 client.4321.objecter successfully canceled tick 2024-04-09T12:05:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 1 -- 172.21.15.29:0/3580222773 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f2d4c06c5e0 msgr2=0x7f2d4c06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f2d4c06c5e0 0x7f2d4c06eaa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d540015f0 tx=0x7f2d54007a40 comp rx=0 tx=0).stop 2024-04-09T12:05:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 10 monclient: shutdown 2024-04-09T12:05:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 1 -- 172.21.15.29:0/3580222773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d6c13e650 msgr2=0x7f2d6c140c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d6c13e650 0x7f2d6c140c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400be20 tx=0x7f2d6400bf10 comp rx=0 tx=0).stop 2024-04-09T12:05:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 1 -- 172.21.15.29:0/3580222773 shutdown_connections 2024-04-09T12:05:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f2d4c06c5e0 0x7f2d4c06eaa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d6c13e650 0x7f2d6c140c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d6c0b4420 0x7f2d6c0ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 1 --2- 172.21.15.29:0/3580222773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d6c0a8830 0x7f2d6c0ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.697+0000 7f2d7242a640 1 -- 172.21.15.29:0/3580222773 >> 172.21.15.29:0/3580222773 conn(0x7f2d6c065f00 msgr2=0x7f2d6c142990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.698+0000 7f2d7242a640 1 -- 172.21.15.29:0/3580222773 shutdown_connections 2024-04-09T12:05:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.698+0000 7f2d7242a640 1 -- 172.21.15.29:0/3580222773 wait complete. 2024-04-09T12:05:23.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.698+0000 7f2d7242a640 1 librados: shutdown 2024-04-09T12:05:23.711 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-09T12:05:23.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.810+0000 7f1d81d62640 10 monclient: get_monmap_and_config 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.810+0000 7f1d81d62640 10 monclient: build_initial_monmap 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.810+0000 7f1d81d62640 10 monclient: monmap: 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:23.811630+0000 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:23.811630+0000 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:23.813 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:23.814 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:23.814 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:23.814 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.810+0000 7f1d81d62640 1 Processor -- start 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.810+0000 7f1d81d62640 1 -- start start 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.810+0000 7f1d81d62640 10 monclient: init 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7c0b4420 0x7f1d7c0a9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 10 monclient(hunting): picked mon.noname-b con 0x7f1d7c0b4420 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1d7c0a8830 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1d7c13e650 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0aa430 con 0x7f1d7c13e650 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0aa710 con 0x7f1d7c0a8830 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0b4800 con 0x7f1d7c0b4420 2024-04-09T12:05:23.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:23.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.811+0000 7f1d81d62640 10 monclient(hunting): authenticate will time out at 1389.931502s 2024-04-09T12:05:23.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.812+0000 7f1d7b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7c0b4420 0x7f1d7c0a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:23.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.812+0000 7f1d7affd640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f1d7c0a8830 0x7f1d7c144b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:46288/0 (socket says 172.21.15.29:46288) 2024-04-09T12:05:23.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.812+0000 7f1d7affd640 1 -- 172.21.15.29:0/2380585027 learned_addr learned my addr 172.21.15.29:0/2380585027 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:23.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.812+0000 7f1d7b7fe640 10 monclient(hunting): get_auth_request con 0x7f1d7c0b4420 auth_method 0 2024-04-09T12:05:23.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.812+0000 7f1d7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:23.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.812+0000 7f1d7b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:23.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.812+0000 7f1d7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:23.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.812+0000 7f1d7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:23.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.812+0000 7f1d7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:23.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.812+0000 7f1d7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:23.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7a7fc640 1 -- 172.21.15.29:0/2380585027 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774639803 0 0) 0x7f1d7c0aa710 con 0x7f1d7c0a8830 2024-04-09T12:05:23.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7a7fc640 10 monclient(hunting): _negotiate 2024-04-09T12:05:23.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:23.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:23.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7a7fc640 10 monclient(hunting): my global_id is 4324 2024-04-09T12:05:23.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7a7fc640 1 -- 172.21.15.29:0/2380585027 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d64003520 con 0x7f1d7c0a8830 2024-04-09T12:05:23.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7b7fe640 10 monclient(hunting): handle_auth_done global_id 4253 payload 274 2024-04-09T12:05:23.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7b7fe640 1 -- 172.21.15.29:0/2380585027 >> v1:172.21.15.173:6789/0 conn(0x7f1d7c0a8830 legacy=0x7f1d7c144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7b7fe640 1 -- 172.21.15.29:0/2380585027 >> v1:172.21.15.29:6789/0 conn(0x7f1d7c13e650 legacy=0x7f1d7c14bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7b7fe640 10 monclient: _finish_hunting 0 2024-04-09T12:05:23.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7b7fe640 1 monclient: found mon.noname-b 2024-04-09T12:05:23.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:23.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:23.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.814+0000 7f1d7b7fe640 1 -- 172.21.15.29:0/2380585027 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0a8d50 con 0x7f1d7c0b4420 2024-04-09T12:05:23.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.816+0000 7f1d7b7fe640 1 --2- 172.21.15.29:0/2380585027 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7c0b4420 0x7f1d7c0a9270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0097d0 tx=0x7f1d6c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55de902fb61f9c8e server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:23.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 1 -- 172.21.15.29:0/2380585027 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c031800 con 0x7f1d7c0b4420 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 10 monclient: dump: 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:23.839 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 10 monclient: _finish_auth 0 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 10 monclient: _check_auth_tickets 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 1 -- 172.21.15.29:0/2380585027 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c031960 con 0x7f1d7c0b4420 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 1 -- 172.21.15.29:0/2380585027 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c031cf0 con 0x7f1d7c0b4420 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d7a7fc640 10 monclient: dump: 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d81d62640 5 monclient: authenticate success, global_id 4253 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d81d62640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d81d62640 4 set_mon_vals no callback set 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d81d62640 10 monclient: shutdown 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d81d62640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d81d62640 1 -- 172.21.15.29:0/2380585027 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7c0b4420 msgr2=0x7f1d7c0a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d81d62640 1 --2- 172.21.15.29:0/2380585027 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7c0b4420 0x7f1d7c0a9270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0097d0 tx=0x7f1d6c02b8a0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d81d62640 1 -- 172.21.15.29:0/2380585027 shutdown_connections 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d81d62640 1 --2- 172.21.15.29:0/2380585027 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7c0b4420 0x7f1d7c0a9270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.835+0000 7f1d81d62640 1 -- 172.21.15.29:0/2380585027 >> 172.21.15.29:0/2380585027 conn(0x7f1d7c065f00 msgr2=0x7f1d7c066310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:23.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.836+0000 7f1d81d62640 1 -- 172.21.15.29:0/2380585027 shutdown_connections 2024-04-09T12:05:23.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.836+0000 7f1d81d62640 1 -- 172.21.15.29:0/2380585027 wait complete. 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.836+0000 7f1d81d62640 10 monclient: build_initial_monmap 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.836+0000 7f1d81d62640 10 monclient: monmap: 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.836+0000 7f1d81d62640 1 librados: starting msgr at 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.836+0000 7f1d81d62640 1 librados: starting objecter 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.836+0000 7f1d81d62640 1 Processor -- start 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 1 -- start start 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 1 librados: setting wanted keys 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 1 librados: calling monclient init 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 10 monclient: init 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c0a8830 0x7f1d7c0ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 10 monclient(hunting): picked mon.noname-b con 0x7f1d7c0a8830 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d7c0b4420 0x7f1d7c0ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 10 monclient(hunting): picked mon.noname-a con 0x7f1d7c0b4420 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7c13e650 0x7f1d7c1da020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 10 monclient(hunting): picked mon.noname-c con 0x7f1d7c13e650 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0ad880 con 0x7f1d7c0b4420 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c1d9b00 con 0x7f1d7c0a8830 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c142dd0 con 0x7f1d7c13e650 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.837+0000 7f1d81d62640 10 monclient(hunting): authenticate will time out at 1389.957759s 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d7c0b4420 0x7f1d7c0ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c0a8830 0x7f1d7c0ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c0a8830 0x7f1d7c0ab600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:40958/0 (socket says 172.21.15.29:40958) 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7b7fe640 1 -- 172.21.15.29:0/1633230816 learned_addr learned my addr 172.21.15.29:0/1633230816 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7b7fe640 10 monclient(hunting): get_auth_request con 0x7f1d7c0a8830 auth_method 0 2024-04-09T12:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7affd640 10 monclient(hunting): get_auth_request con 0x7f1d7c0b4420 auth_method 0 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.838+0000 7f1d7affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.839+0000 7f1d7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.839+0000 7f1d7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.839+0000 7f1d7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.839+0000 7f1d7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.839+0000 7f1d7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.839+0000 7f1d7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.839+0000 7f1d7bfff640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7c13e650 0x7f1d7c1da020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.840+0000 7f1d7bfff640 10 monclient(hunting): get_auth_request con 0x7f1d7c13e650 auth_method 0 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.840+0000 7f1d7bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.840+0000 7f1d7bfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.840+0000 7f1d7bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.841+0000 7f1d7bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.841+0000 7f1d7bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.841+0000 7f1d7bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.841+0000 7f1d7b7fe640 10 monclient(hunting): handle_auth_done global_id 4327 payload 824 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.841+0000 7f1d7b7fe640 1 -- 172.21.15.29:0/1633230816 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7c13e650 msgr2=0x7f1d7c1da020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.841+0000 7f1d7b7fe640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7c13e650 0x7f1d7c1da020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.841+0000 7f1d7b7fe640 1 -- 172.21.15.29:0/1633230816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d7c0b4420 msgr2=0x7f1d7c0ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.841+0000 7f1d7b7fe640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d7c0b4420 0x7f1d7c0ac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.841+0000 7f1d7b7fe640 10 monclient: _finish_hunting 0 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.841+0000 7f1d7b7fe640 1 monclient: found mon.noname-b 2024-04-09T12:05:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.841+0000 7f1d7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.842+0000 7f1d7b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.842+0000 7f1d7b7fe640 1 -- 172.21.15.29:0/1633230816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c009400 con 0x7f1d7c0a8830 2024-04-09T12:05:23.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.844+0000 7f1d7b7fe640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c0a8830 0x7f1d7c0ab600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0098f0 tx=0x7f1d6c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:23.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.844+0000 7f1d63fff640 10 client.?.objecter ms_handle_connect 0x7f1d7c0a8830 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.844+0000 7f1d63fff640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 1 -- 172.21.15.29:0/1633230816 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c03bc70 con 0x7f1d7c0a8830 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 10 monclient: dump: 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 10 monclient: _finish_auth 0 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 10 monclient: _check_auth_tickets 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 1 -- 172.21.15.29:0/1633230816 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c03be10 con 0x7f1d7c0a8830 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d81d62640 5 monclient: authenticate success, global_id 4327 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d81d62640 10 monclient: _renew_subs 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d81d62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d81d62640 1 -- 172.21.15.29:0/1633230816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c0b18d0 con 0x7f1d7c0a8830 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 1 -- 172.21.15.29:0/1633230816 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c045630 con 0x7f1d7c0a8830 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d63fff640 10 monclient: dump: 2024-04-09T12:05:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d79ffb640 4 set_mon_vals no callback set 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d81d62640 10 client.4327.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d81d62640 10 monclient: _renew_subs 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d81d62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d81d62640 1 -- 172.21.15.29:0/1633230816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c141090 con 0x7f1d7c0a8830 2024-04-09T12:05:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.848+0000 7f1d81d62640 1 librados: init done 2024-04-09T12:05:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.849+0000 7f1d81d62640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.849+0000 7f1d81d62640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.849+0000 7f1d81d62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.849+0000 7f1d81d62640 1 -- 172.21.15.29:0/1633230816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c04e160 con 0x7f1d7c0a8830 2024-04-09T12:05:23.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.866+0000 7f1d63fff640 1 -- 172.21.15.29:0/1633230816 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1d6c04e450 con 0x7f1d7c0a8830 2024-04-09T12:05:23.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.866+0000 7f1d63fff640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f1d6806c5e0 0x7f1d6806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:23.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.867+0000 7f1d7affd640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f1d6806c5e0 0x7f1d6806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:23.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.867+0000 7f1d7affd640 10 monclient: get_auth_request con 0x7f1d6806c5e0 auth_method 0 2024-04-09T12:05:23.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.867+0000 7f1d63fff640 10 client.4327.objecter ms_handle_connect 0x7f1d6806c5e0 2024-04-09T12:05:23.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:23.867+0000 7f1d7affd640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f1d6806c5e0 0x7f1d6806eaa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c067b10 tx=0x7f1d70007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.103+0000 7f1d63fff640 1 -- 172.21.15.29:0/1633230816 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1d6c02e070 con 0x7f1d7c0a8830 2024-04-09T12:05:24.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.103+0000 7f1d63fff640 10 client.4327.objecter ms_dispatch 0x7f1d7c000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:24.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.103+0000 7f1d63fff640 3 client.4327.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:24.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.103+0000 7f1d63fff640 3 client.4327.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:24.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.103+0000 7f1d63fff640 20 client.4327.objecter dump_active .. 0 homeless 2024-04-09T12:05:24.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.113+0000 7f1d63fff640 1 -- 172.21.15.29:0/1633230816 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f1d6c076dd0 con 0x7f1d7c0a8830 2024-04-09T12:05:24.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.113+0000 7f1d63fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:24.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.113+0000 7f1d63fff640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:24.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.301+0000 7f1d81d62640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:24.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.301+0000 7f1d81d62640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:24.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.301+0000 7f1d81d62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.301+0000 7f1d81d62640 1 -- 172.21.15.29:0/1633230816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d7c1440f0 con 0x7f1d7c0a8830 2024-04-09T12:05:24.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.332+0000 7f1d63fff640 1 -- 172.21.15.29:0/1633230816 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14194 (secure 0 0 0) 0x7f1d6c035070 con 0x7f1d7c0a8830 2024-04-09T12:05:24.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.332+0000 7f1d63fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-09T12:05:24.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.332+0000 7f1d63fff640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:24.336 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:05:24.336 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"1673ebad-34a7-414e-b498-c4f5250b317b","created":"2024-04-09T12:04:18.271948+0000","modified":"2024-04-09T12:05:23.209773+0000","last_up_change":"2024-04-09T12:05:15.358605+0000","last_in_change":"2024-04-09T12:04:23.695144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-09T12:05:04.691771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-09T12:05:20.460989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c929787-7de5-4d2f-9b36-3a165fa73386","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":35238},{"type":"v1","addr":"172.21.15.29:6809","nonce":35238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":35238},{"type":"v1","addr":"172.21.15.29:6811","nonce":35238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":35238},{"type":"v1","addr":"172.21.15.29:6815","nonce":35238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":35238},{"type":"v1","addr":"172.21.15.29:6813","nonce":35238}]},"public_addr":"172.21.15.29:6809/35238","cluster_addr":"172.21.15.29:6811/35238","heartbeat_back_addr":"172.21.15.29:6815/35238","heartbeat_front_addr":"172.21.15.29:6813/35238","state":["exists","up"]},{"osd":1,"uuid":"54d0b5c7-3415-4585-8a9b-c67a8ae94ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":35236},{"type":"v1","addr":"172.21.15.29:6825","nonce":35236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":35236},{"type":"v1","addr":"172.21.15.29:6827","nonce":35236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":35236},{"type":"v1","addr":"172.21.15.29:6831","nonce":35236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":35236},{"type":"v1","addr":"172.21.15.29:6829","nonce":35236}]},"public_addr":"172.21.15.29:6825/35236","cluster_addr":"172.21.15.29:6827/35236","heartbeat_back_addr":"172.21.15.29:6831/35236","heartbeat_front_addr":"172.21.15.29:6829/35236","state":["exists","up"]},{"osd":2,"uuid":"7a343481-8465-4e19-989c-4a62c926338c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":35237},{"type":"v1","addr":"172.21.15.29:6801","nonce":35237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":35237},{"type":"v1","addr":"172.21.15.29:6803","nonce":35237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":35237},{"type":"v1","addr":"172.21.15.29:6807","nonce":35237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":35237},{"type":"v1","addr":"172.21.15.29:6805","nonce":35237}]},"public_addr":"172.21.15.29:6801/35237","cluster_addr":"172.21.15.29:6803/35237","heartbeat_back_addr":"172.21.15.29:6807/35237","heartbeat_front_addr":"172.21.15.29:6805/35237","state":["exists","up"]},{"osd":3,"uuid":"7c35a4df-9a28-42d8-9da2-d2b8e5aefcb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":35239},{"type":"v1","addr":"172.21.15.29:6817","nonce":35239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":35239},{"type":"v1","addr":"172.21.15.29:6819","nonce":35239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":35239},{"type":"v1","addr":"172.21.15.29:6823","nonce":35239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":35239},{"type":"v1","addr":"172.21.15.29:6821","nonce":35239}]},"public_addr":"172.21.15.29:6817/35239","cluster_addr":"172.21.15.29:6819/35239","heartbeat_back_addr":"172.21.15.29:6823/35239","heartbeat_front_addr":"172.21.15.29:6821/35239","state":["exists","up"]},{"osd":4,"uuid":"7f553202-73e9-496c-893f-185c61f66807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":35529},{"type":"v1","addr":"172.21.15.173:6819","nonce":35529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":35529},{"type":"v1","addr":"172.21.15.173:6821","nonce":35529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6825","nonce":35529},{"type":"v1","addr":"172.21.15.173:6827","nonce":35529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":35529},{"type":"v1","addr":"172.21.15.173:6824","nonce":35529}]},"public_addr":"172.21.15.173:6819/35529","cluster_addr":"172.21.15.173:6821/35529","heartbeat_back_addr":"172.21.15.173:6827/35529","heartbeat_front_addr":"172.21.15.173:6824/35529","state":["exists","up"]},{"osd":5,"uuid":"84050623-d3f3-40ba-b63e-92d56a74bfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":35531},{"type":"v1","addr":"172.21.15.173:6826","nonce":35531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":35531},{"type":"v1","addr":"172.21.15.173:6829","nonce":35531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":35531},{"type":"v1","addr":"172.21.15.173:6833","nonce":35531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":35531},{"type":"v1","addr":"172.21.15.173:6831","nonce":35531}]},"public_addr":"172.21.15.173:6826/35531","cluster_addr":"172.21.15.173:6829/35531","heartbeat_back_addr":"172.21.15.173:6833/35531","heartbeat_front_addr":"172.21.15.173:6831/35531","state":["exists","up"]},{"osd":6,"uuid":"883e841f-8acc-4268-8e64-c556b10befa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":35530},{"type":"v1","addr":"172.21.15.173:6803","nonce":35530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":35530},{"type":"v1","addr":"172.21.15.173:6805","nonce":35530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":35530},{"type":"v1","addr":"172.21.15.173:6809","nonce":35530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":35530},{"type":"v1","addr":"172.21.15.173:6807","nonce":35530}]},"public_addr":"172.21.15.173:6803/35530","cluster_addr":"172.21.15.173:6805/35530","heartbeat_back_addr":"172.21.15.173:6809/35530","heartbeat_front_addr":"172.21.15.173:6807/35530","state":["exists","up"]},{"osd":7,"uuid":"126085be-23ad-45b6-951d-47886bdfa75c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":35532},{"type":"v1","addr":"172.21.15.173:6811","nonce":35532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":35532},{"type":"v1","addr":"172.21.15.173:6813","nonce":35532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":35532},{"type":"v1","addr":"172.21.15.173:6817","nonce":35532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":35532},{"type":"v1","addr":"172.21.15.173:6815","nonce":35532}]},"public_addr":"172.21.15.173:6811/35532","cluster_addr":"172.21.15.173:6813/35532","heartbeat_back_addr":"172.21.15.173:6817/35532","heartbeat_front_addr":"172.21.15.173:6815/35532","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:01.923058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:03.497855+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:02.626090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:02.816164+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:01.755586+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:00.598310+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:00.974235+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-09T12:05:01.169040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-09T12:05:24.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 10 librados: watch_flush enter 2024-04-09T12:05:24.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 10 librados: watch_flush exit 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 20 client.4327.objecter shutdown clearing up homeless session... 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 10 client.4327.objecter successfully canceled tick 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 -- 172.21.15.29:0/1633230816 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f1d6806c5e0 msgr2=0x7f1d6806eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f1d6806c5e0 0x7f1d6806eaa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c067b10 tx=0x7f1d70007d30 comp rx=0 tx=0).stop 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 10 monclient: shutdown 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 -- 172.21.15.29:0/1633230816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c0a8830 msgr2=0x7f1d7c0ab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c0a8830 0x7f1d7c0ab600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0098f0 tx=0x7f1d6c0046c0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 -- 172.21.15.29:0/1633230816 shutdown_connections 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f1d6806c5e0 0x7f1d6806eaa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7c13e650 0x7f1d7c1da020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d7c0b4420 0x7f1d7c0ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 --2- 172.21.15.29:0/1633230816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c0a8830 0x7f1d7c0ab600 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 -- 172.21.15.29:0/1633230816 >> 172.21.15.29:0/1633230816 conn(0x7f1d7c065f00 msgr2=0x7f1d7c068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 -- 172.21.15.29:0/1633230816 shutdown_connections 2024-04-09T12:05:24.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 -- 172.21.15.29:0/1633230816 wait complete. 2024-04-09T12:05:24.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.334+0000 7f1d81d62640 1 librados: shutdown 2024-04-09T12:05:24.348 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-09T12:05:24.349 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-09T12:05:24.349 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-09T12:05:24.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-09T12:05:24.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-09T12:05:24.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-09T12:05:24.351 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-09T12:05:24.351 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-09T12:05:24.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.522+0000 7f486ffff640 10 monclient: get_monmap_and_config 2024-04-09T12:05:24.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.522+0000 7f486ffff640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.522+0000 7f486ffff640 10 monclient: monmap: 2024-04-09T12:05:24.525 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.525 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.525 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.523631+0000 2024-04-09T12:05:24.525 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.523631+0000 2024-04-09T12:05:24.526 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.526 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.526 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:24.526 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:24.526 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:24.526 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:24.526 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:24.526 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.523+0000 7f486ffff640 1 Processor -- start 2024-04-09T12:05:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.523+0000 7f486ffff640 1 -- start start 2024-04-09T12:05:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.523+0000 7f486ffff640 10 monclient: init 2024-04-09T12:05:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 10 monclient: _add_conns ranks=[1,4,3,0,2] 2024-04-09T12:05:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4868038d70 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4868039150 0x7f48680c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f4868039150 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4868036480 0x7f48680c8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f4868036480 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4868037570 con 0x7f4868038d70 2024-04-09T12:05:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48680c7e60 con 0x7f4868036480 2024-04-09T12:05:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4868035430 con 0x7f4868039150 2024-04-09T12:05:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486ffff640 10 monclient(hunting): authenticate will time out at 1390.644124s 2024-04-09T12:05:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f6f938dc640 10 monclient: get_monmap_and_config 2024-04-09T12:05:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f6f938dc640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f6f938dc640 10 monclient: monmap: 2024-04-09T12:05:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.526020+0000 2024-04-09T12:05:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.526020+0000 2024-04-09T12:05:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:24.529 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f8c1f548640 10 monclient: get_monmap_and_config 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f8c1f548640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f8c1f548640 10 monclient: monmap: 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.526086+0000 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.526086+0000 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:24.531 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.524+0000 7f486e7fc640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4868039150 0x7f48680c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4868036480 0x7f48680c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486e7fc640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4868039150 0x7f48680c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:40964/0 (socket says 172.21.15.29:40964) 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486e7fc640 1 -- 172.21.15.29:0/1143697430 learned_addr learned my addr 172.21.15.29:0/1143697430 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486e7fc640 10 monclient(hunting): get_auth_request con 0x7f4868039150 auth_method 0 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486f7fe640 10 monclient(hunting): get_auth_request con 0x7f4868036480 auth_method 0 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f486e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f6f938dc640 1 Processor -- start 2024-04-09T12:05:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f6f938dc640 1 -- start start 2024-04-09T12:05:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.525+0000 7f6f938dc640 10 monclient: init 2024-04-09T12:05:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f486f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f486f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f486f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7fdc76b91640 10 monclient: get_monmap_and_config 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7fdc76b91640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7fdc76b91640 10 monclient: monmap: 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.527956+0000 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.527956+0000 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:24.535 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:24.535 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:24.535 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f8c1f548640 1 Processor -- start 2024-04-09T12:05:24.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f8c1f548640 1 -- start start 2024-04-09T12:05:24.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f8c1f548640 10 monclient: init 2024-04-09T12:05:24.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f8c065d80 0x7f6f8c1459d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 10 monclient(hunting): picked mon.noname-a con 0x7f6f8c065d80 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6f8c071750 0x7f6f8c145f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 10 monclient(hunting): picked mon.noname-c con 0x7f6f8c071750 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6f8c0ae790 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c0b0000 con 0x7f6f8c0ae790 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c066160 con 0x7f6f8c065d80 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c071ca0 con 0x7f6f8c071750 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.526+0000 7f6f938dc640 10 monclient(hunting): authenticate will time out at 1390.646976s 2024-04-09T12:05:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2024-04-09T12:05:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c1806bd40 0x7f8c18070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 10 monclient(hunting): picked mon.noname-a con 0x7f8c1806bd40 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 0x7f8c1806e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 10 monclient(hunting): picked mon.noname-b con 0x7f8c1806d950 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8c1806ea40 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:24.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1806fba0 con 0x7f8c1806ea40 2024-04-09T12:05:24.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f486e7fc640 10 monclient(hunting): handle_auth_done global_id 4330 payload 274 2024-04-09T12:05:24.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f486e7fc640 1 -- 172.21.15.29:0/1143697430 >> v2:172.21.15.29:3300/0 conn(0x7f4868036480 msgr2=0x7f48680c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f486e7fc640 1 --2- 172.21.15.29:0/1143697430 >> v2:172.21.15.29:3300/0 conn(0x7f4868036480 0x7f48680c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1806f9c0 con 0x7f8c1806bd40 2024-04-09T12:05:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18140ab0 con 0x7f8c1806d950 2024-04-09T12:05:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.527+0000 7f8c1f548640 10 monclient(hunting): authenticate will time out at 1390.647729s 2024-04-09T12:05:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7f03e1024640 10 monclient: get_monmap_and_config 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7f03e1024640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7f03e1024640 10 monclient: monmap: 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.529672+0000 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.529672+0000 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:24.540 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7fdc76b91640 1 Processor -- start 2024-04-09T12:05:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7fdc76b91640 1 -- start start 2024-04-09T12:05:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7fdc76b91640 10 monclient: init 2024-04-09T12:05:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7f486e7fc640 1 -- 172.21.15.29:0/1143697430 >> v1:172.21.15.173:6789/0 conn(0x7f4868038d70 legacy=0x7f48680c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7f486e7fc640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7f486e7fc640 1 monclient: found mon.noname-c 2024-04-09T12:05:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7f486e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7f486e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.528+0000 7f486e7fc640 1 -- 172.21.15.29:0/1143697430 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48680c5930 con 0x7f4868039150 2024-04-09T12:05:24.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7f8c1dd45640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 0x7f8c1806e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7f8c1dd45640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 0x7f8c1806e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39224/0 (socket says 172.21.15.29:39224) 2024-04-09T12:05:24.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7fdc76b91640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7f8c1dd45640 1 -- 172.21.15.29:0/2770396351 learned_addr learned my addr 172.21.15.29:0/2770396351 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7f8c1dd45640 10 monclient(hunting): get_auth_request con 0x7f8c1806d950 auth_method 0 2024-04-09T12:05:24.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7fdc76b91640 10 monclient: _add_conns ranks=[2,4,0,3,1] 2024-04-09T12:05:24.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7f8c1dd45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7f8c1dd45640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7f8c1dd45640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7fdc76b91640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdc700b43d0 0x7fdc700a8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7f03e1024640 1 Processor -- start 2024-04-09T12:05:24.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7fdc76b91640 10 monclient(hunting): picked mon.noname-b con 0x7fdc700b43d0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7f03e1024640 1 -- start start 2024-04-09T12:05:24.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7f03e1024640 10 monclient: init 2024-04-09T12:05:24.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7fdc76b91640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdc7013e970 0x7fdc7013edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.529+0000 7fdc76b91640 10 monclient(hunting): picked mon.noname-c con 0x7fdc7013e970 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:24.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7fdc76b91640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdc70144c50 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:24.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7fdc76b91640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc700aa750 con 0x7fdc70144c50 2024-04-09T12:05:24.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f8c1dd45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7fdc76b91640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7fdc76b91640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc700a8e80 con 0x7fdc7013e970 2024-04-09T12:05:24.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7fdc76b91640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7fdc76b91640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700b47b0 con 0x7fdc700b43d0 2024-04-09T12:05:24.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7fdc76b91640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7fdc76b91640 10 monclient(hunting): authenticate will time out at 1390.650327s 2024-04-09T12:05:24.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f8c1dd45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f8c1dd45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f6f91678640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f8c065d80 0x7f6f8c1459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f6f90e77640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6f8c071750 0x7f6f8c145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2024-04-09T12:05:24.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f03dc0ac880 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:24.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f03dc0acc60 0x7f03dc071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 10 monclient(hunting): picked mon.noname-a con 0x7f03dc0acc60 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:24.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f03dc0af350 0x7f03dc141510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 10 monclient(hunting): picked mon.noname-b con 0x7f03dc0af350 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc06f050 con 0x7f03dc0ac880 2024-04-09T12:05:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc06da00 con 0x7f03dc0acc60 2024-04-09T12:05:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc071c40 con 0x7f03dc0af350 2024-04-09T12:05:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.530+0000 7f03e1024640 10 monclient(hunting): authenticate will time out at 1390.650585s 2024-04-09T12:05:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.531+0000 7f486e7fc640 1 --2- 172.21.15.29:0/1143697430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4868039150 0x7f48680c8310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48680082d0 tx=0x7f486402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e48307ba9ad867f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.531+0000 7fa7c6d47640 10 monclient: get_monmap_and_config 2024-04-09T12:05:24.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.531+0000 7fa7c6d47640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.531+0000 7fa7c6d47640 10 monclient: monmap: 2024-04-09T12:05:24.551 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.551 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.551 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.533061+0000 2024-04-09T12:05:24.551 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.533061+0000 2024-04-09T12:05:24.551 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.551 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.552 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:24.552 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:24.552 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:24.552 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:24.552 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:24.552 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.531+0000 7f6f90e77640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6f8c071750 0x7f6f8c145f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:40978/0 (socket says 172.21.15.29:40978) 2024-04-09T12:05:24.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.531+0000 7f6f90e77640 1 -- 172.21.15.29:0/1761854981 learned_addr learned my addr 172.21.15.29:0/1761854981 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.531+0000 7f6f90e77640 10 monclient(hunting): get_auth_request con 0x7f6f8c071750 auth_method 0 2024-04-09T12:05:24.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.531+0000 7f6f90e77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.531+0000 7f6f90e77640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.531+0000 7f6f90e77640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7fdc6ffff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdc7013e970 0x7fdc7013edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7fa7c6d47640 1 Processor -- start 2024-04-09T12:05:24.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7fa7c6d47640 1 -- start start 2024-04-09T12:05:24.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f03dbfff640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f03dc0ac880 0x7f03dc06d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:46312/0 (socket says 172.21.15.29:46312) 2024-04-09T12:05:24.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f03dbfff640 1 -- 172.21.15.29:0/474244741 learned_addr learned my addr 172.21.15.29:0/474244741 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:24.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7fa7c6d47640 10 monclient: init 2024-04-09T12:05:24.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f8c1e546640 1 --2- 172.21.15.29:0/2770396351 >> v2:172.21.15.29:3300/0 conn(0x7f8c1806bd40 0x7f8c18070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f6f91678640 10 monclient(hunting): get_auth_request con 0x7f6f8c065d80 auth_method 0 2024-04-09T12:05:24.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f6f91678640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f6f91678640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f6f91678640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f8c1dd45640 10 monclient(hunting): handle_auth_done global_id 4259 payload 274 2024-04-09T12:05:24.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f8c1dd45640 1 -- 172.21.15.29:0/2770396351 >> v2:172.21.15.29:3300/0 conn(0x7f8c1806bd40 msgr2=0x7f8c18070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f8c1dd45640 1 --2- 172.21.15.29:0/2770396351 >> v2:172.21.15.29:3300/0 conn(0x7f8c1806bd40 0x7f8c18070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f8c1dd45640 1 -- 172.21.15.29:0/2770396351 >> v1:172.21.15.29:6789/0 conn(0x7f8c1806ea40 legacy=0x7f8c1813d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f8c1dd45640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f8c1dd45640 1 monclient: found mon.noname-b 2024-04-09T12:05:24.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f8c1dd45640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f8c1dd45640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.532+0000 7f8c1dd45640 1 -- 172.21.15.29:0/2770396351 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1806fe80 con 0x7f8c1806d950 2024-04-09T12:05:24.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 10 monclient: _add_conns ranks=[0,2,3,1,4] 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa7c00b4070 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c013e710 0x7fa7c013eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 10 monclient(hunting): picked mon.noname-b con 0x7fa7c013e710 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa7c0144ad0 0x7fa7c0144f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 10 monclient(hunting): picked mon.noname-a con 0x7fa7c0144ad0 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c00a9520 con 0x7fa7c00b4070 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c00b4450 con 0x7fa7c0144ad0 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00aa000 con 0x7fa7c013e710 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.533+0000 7fa7c6d47640 10 monclient(hunting): authenticate will time out at 1390.653278s 2024-04-09T12:05:24.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.534+0000 7f6f91678640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.534+0000 7f6f91678640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.534+0000 7f6f91678640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.534+0000 7f35a6adb640 10 monclient: get_monmap_and_config 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.534+0000 7f35a6adb640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.534+0000 7f35a6adb640 10 monclient: monmap: 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.535942+0000 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.535942+0000 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:24.562 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.534+0000 7f6f90e77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.534+0000 7f6f90e77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.534+0000 7f6f90e77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.535+0000 7f35a6adb640 1 Processor -- start 2024-04-09T12:05:24.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.535+0000 7f35a6adb640 1 -- start start 2024-04-09T12:05:24.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.535+0000 7f35a6adb640 10 monclient: init 2024-04-09T12:05:24.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f03e0823640 1 --2- 172.21.15.29:0/474244741 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f03dc0af350 0x7f03dc141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7fdc7492d640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdc700b43d0 0x7fdc700a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3598036df0 0x7f35980c2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 10 monclient(hunting): picked mon.noname-c con 0x7f3598036df0 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f35980355b0 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35980c3130 0x7f35980c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 10 monclient(hunting): picked mon.noname-b con 0x7f35980c3130 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35980c35c0 con 0x7f35980355b0 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35980371d0 con 0x7f3598036df0 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359802e6b0 con 0x7f35980c3130 2024-04-09T12:05:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f35a6adb640 10 monclient(hunting): authenticate will time out at 1390.656648s 2024-04-09T12:05:24.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f03e0823640 10 monclient(hunting): get_auth_request con 0x7f03dc0af350 auth_method 0 2024-04-09T12:05:24.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f03e0823640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f03e0823640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f03e0823640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f6f90e77640 10 monclient(hunting): handle_auth_done global_id 4333 payload 274 2024-04-09T12:05:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f6f90e77640 1 -- 172.21.15.29:0/1761854981 >> v2:172.21.15.29:3300/0 conn(0x7f6f8c065d80 msgr2=0x7f6f8c1459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f6f90e77640 1 --2- 172.21.15.29:0/1761854981 >> v2:172.21.15.29:3300/0 conn(0x7f6f8c065d80 0x7f6f8c1459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f6f90e77640 1 -- 172.21.15.29:0/1761854981 >> v1:172.21.15.29:6789/0 conn(0x7f6f8c0ae790 legacy=0x7f6f8c0aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f6f90e77640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f6f90e77640 1 monclient: found mon.noname-c 2024-04-09T12:05:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f6f90e77640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f6f90e77640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.536+0000 7f6f90e77640 1 -- 172.21.15.29:0/1761854981 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0afc40 con 0x7f6f8c071750 2024-04-09T12:05:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.537+0000 7f8c1dd45640 1 --2- 172.21.15.29:0/2770396351 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 0x7f8c1806e500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8c08009870 tx=0x7f8c0802fe90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48ad186b15892113 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.537+0000 7f03e0823640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.537+0000 7f03e0823640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.537+0000 7f03e0823640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.537+0000 7fdc7512e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdc70144c50 0x7fdc701450e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59198/0 (socket says 172.21.15.29:59198) 2024-04-09T12:05:24.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.537+0000 7fdc7512e640 1 -- 172.21.15.29:0/922054771 learned_addr learned my addr 172.21.15.29:0/922054771 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:24.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.537+0000 7fdc7492d640 10 monclient(hunting): get_auth_request con 0x7fdc700b43d0 auth_method 0 2024-04-09T12:05:24.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.537+0000 7fdc7492d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.537+0000 7fdc7492d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.537+0000 7fdc7492d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.538+0000 7f6f90e77640 1 --2- 172.21.15.29:0/1761854981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f8c071750 0x7f6f8c145f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c06f320 tx=0x7f6f8402bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a482cfda7e36872 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.539+0000 7fdc6ffff640 10 monclient(hunting): get_auth_request con 0x7fdc7013e970 auth_method 0 2024-04-09T12:05:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.539+0000 7fdc6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.539+0000 7fdc6ffff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.539+0000 7fdc6ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.540+0000 7f03e0823640 10 monclient(hunting): handle_auth_done global_id 4262 payload 274 2024-04-09T12:05:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.540+0000 7f03e0823640 1 -- 172.21.15.29:0/474244741 >> v2:172.21.15.29:3300/0 conn(0x7f03dc0acc60 msgr2=0x7f03dc071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.540+0000 7f03e0823640 1 --2- 172.21.15.29:0/474244741 >> v2:172.21.15.29:3300/0 conn(0x7f03dc0acc60 0x7f03dc071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.540+0000 7f03e0823640 1 -- 172.21.15.29:0/474244741 >> v1:172.21.15.173:6789/0 conn(0x7f03dc0ac880 legacy=0x7f03dc06d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.540+0000 7f03e0823640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.540+0000 7f03e0823640 1 monclient: found mon.noname-b 2024-04-09T12:05:24.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.540+0000 7f03e0823640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.540+0000 7f03e0823640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.540+0000 7f03e0823640 1 -- 172.21.15.29:0/474244741 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc070b60 con 0x7f03dc0af350 2024-04-09T12:05:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.541+0000 7fdc6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.541+0000 7fdc6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.542+0000 7fdc6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.543+0000 7fdc7492d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.543+0000 7fdc7492d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fdc7492d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fdc6ffff640 10 monclient(hunting): handle_auth_done global_id 4339 payload 274 2024-04-09T12:05:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fdc6ffff640 1 -- 172.21.15.29:0/922054771 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdc700b43d0 msgr2=0x7fdc700a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fdc6ffff640 1 --2- 172.21.15.29:0/922054771 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdc700b43d0 0x7fdc700a8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fdc6ffff640 1 -- 172.21.15.29:0/922054771 >> v1:172.21.15.29:6789/0 conn(0x7fdc70144c50 legacy=0x7fdc701450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fdc6ffff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fdc6ffff640 1 monclient: found mon.noname-c 2024-04-09T12:05:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fdc6ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fdc6ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fdc6ffff640 1 -- 172.21.15.29:0/922054771 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc700a9060 con 0x7fdc7013e970 2024-04-09T12:05:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fa7bffff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c013e710 0x7fa7c013eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fa7bffff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c013e710 0x7fa7c013eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39240/0 (socket says 172.21.15.29:39240) 2024-04-09T12:05:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fa7bffff640 1 -- 172.21.15.29:0/932558925 learned_addr learned my addr 172.21.15.29:0/932558925 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fa7bffff640 10 monclient(hunting): get_auth_request con 0x7fa7c013e710 auth_method 0 2024-04-09T12:05:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fa7bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fa7bffff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.544+0000 7fa7bffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.545+0000 7f7d7c6ae640 10 monclient: get_monmap_and_config 2024-04-09T12:05:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.545+0000 7f7d7c6ae640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.545+0000 7f7d7c6ae640 10 monclient: monmap: 2024-04-09T12:05:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.546606+0000 2024-04-09T12:05:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.546606+0000 2024-04-09T12:05:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:24.575 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.545+0000 7fa7bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.545+0000 7fa7bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.545+0000 7fa7bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.545+0000 7f7d7c6ae640 1 Processor -- start 2024-04-09T12:05:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.545+0000 7f7d7c6ae640 1 -- start start 2024-04-09T12:05:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.545+0000 7f7d7c6ae640 10 monclient: init 2024-04-09T12:05:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.546+0000 7f7d7c6ae640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.546+0000 7f7d7c6ae640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2024-04-09T12:05:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.546+0000 7f7d7c6ae640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d740b43f0 0x7f7d740a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.546+0000 7f7d7c6ae640 10 monclient(hunting): picked mon.noname-b con 0x7f7d740b43f0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.546+0000 7f7d7c6ae640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7d74141640 0x7f7d74141a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7f7d7c6ae640 10 monclient(hunting): picked mon.noname-a con 0x7f7d74141640 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7f7d7c6ae640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7d740b1b90 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7f7d7c6ae640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d740a9070 con 0x7f7d740b1b90 2024-04-09T12:05:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7f7d7c6ae640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7f7d7c6ae640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d740b47d0 con 0x7f7d74141640 2024-04-09T12:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7f7d7c6ae640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7f7d7c6ae640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740a8dc0 con 0x7f7d740b43f0 2024-04-09T12:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7f7d7c6ae640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7f7d7c6ae640 10 monclient(hunting): authenticate will time out at 1390.667128s 2024-04-09T12:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7fa7c52e4640 1 --2- 172.21.15.29:0/932558925 >> v2:172.21.15.29:3300/0 conn(0x7fa7c0144ad0 0x7fa7c0144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7fa7bffff640 10 monclient(hunting): handle_auth_done global_id 4268 payload 274 2024-04-09T12:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7fa7bffff640 1 -- 172.21.15.29:0/932558925 >> v2:172.21.15.29:3300/0 conn(0x7fa7c0144ad0 msgr2=0x7fa7c0144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7fa7bffff640 1 --2- 172.21.15.29:0/932558925 >> v2:172.21.15.29:3300/0 conn(0x7fa7c0144ad0 0x7fa7c0144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7fa7bffff640 1 -- 172.21.15.29:0/932558925 >> v1:172.21.15.29:6789/0 conn(0x7fa7c00b4070 legacy=0x7fa7c00a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7fa7bffff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7fa7bffff640 1 monclient: found mon.noname-b 2024-04-09T12:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7fa7bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7fa7bffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.547+0000 7fa7bffff640 1 -- 172.21.15.29:0/932558925 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c00aa2e0 con 0x7fa7c013e710 2024-04-09T12:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.548+0000 7f03e0823640 1 --2- 172.21.15.29:0/474244741 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f03dc0af350 0x7f03dc141510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009d90 tx=0x7f03d402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88ff619dc8c82818 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.548+0000 7fdc6ffff640 1 --2- 172.21.15.29:0/922054771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc7013e970 0x7fdc7013edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0097d0 tx=0x7fdc5c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d907f943d0fa778 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.548+0000 7f35a52d8640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f35980355b0 0x7f35980c8f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:46328/0 (socket says 172.21.15.29:46328) 2024-04-09T12:05:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.548+0000 7f35a52d8640 1 -- 172.21.15.29:0/1148779603 learned_addr learned my addr 172.21.15.29:0/1148779603 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.550+0000 7f7d79c49640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7d74141640 0x7f7d74141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.551+0000 7f35a5ad9640 1 --2- 172.21.15.29:0/1148779603 >> v2:172.21.15.173:3300/0 conn(0x7f3598036df0 0x7f35980c2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.551+0000 7f35a5ad9640 10 monclient(hunting): get_auth_request con 0x7f3598036df0 auth_method 0 2024-04-09T12:05:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.551+0000 7f35a5ad9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.551+0000 7f35a5ad9640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.551+0000 7f35a5ad9640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.551+0000 7f7d79c49640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7d74141640 0x7f7d74141a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48042/0 (socket says 172.21.15.29:48042) 2024-04-09T12:05:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.551+0000 7f7d79c49640 1 -- 172.21.15.29:0/1026176994 learned_addr learned my addr 172.21.15.29:0/1026176994 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.551+0000 7f7d79c49640 10 monclient(hunting): get_auth_request con 0x7f7d74141640 auth_method 0 2024-04-09T12:05:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.551+0000 7f7d79c49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.551+0000 7f7d79c49640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.551+0000 7f7d79c49640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.552+0000 7f7d79c49640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.552+0000 7f7d79c49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.552+0000 7f7d79c49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 1 -- 172.21.15.29:0/1143697430 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640317e0 con 0x7f4868039150 2024-04-09T12:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 10 monclient: dump: 2024-04-09T12:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486ffff640 5 monclient: authenticate success, global_id 4330 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486ffff640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 1 -- 172.21.15.29:0/1143697430 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4864031940 con 0x7f4868039150 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486ffff640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486ffff640 4 set_mon_vals no callback set 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 1 -- 172.21.15.29:0/1143697430 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640317e0 con 0x7f4868039150 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.553+0000 7f486dffb640 10 monclient: dump: 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 10 monclient: shutdown 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 1 -- 172.21.15.29:0/1143697430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4868039150 msgr2=0x7f48680c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 1 --2- 172.21.15.29:0/1143697430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4868039150 0x7f48680c8310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48680082d0 tx=0x7f486402b880 comp rx=0 tx=0).stop 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 1 -- 172.21.15.29:0/1143697430 shutdown_connections 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 1 --2- 172.21.15.29:0/1143697430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4868039150 0x7f48680c8310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 1 --2- 172.21.15.29:0/1143697430 >> v2:172.21.15.29:3300/0 conn(0x7f4868036480 0x7f48680c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 1 -- 172.21.15.29:0/1143697430 >> 172.21.15.29:0/1143697430 conn(0x7f48680065d0 msgr2=0x7f48680069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 1 -- 172.21.15.29:0/1143697430 shutdown_connections 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 1 -- 172.21.15.29:0/1143697430 wait complete. 2024-04-09T12:05:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.554+0000 7f486ffff640 10 monclient: monmap: 2024-04-09T12:05:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:24.590 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f7d79c49640 10 monclient(hunting): handle_auth_done global_id 4281 payload 274 2024-04-09T12:05:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f7d79c49640 1 -- 172.21.15.29:0/1026176994 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d740b43f0 msgr2=0x7f7d740a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f7d79c49640 1 --2- 172.21.15.29:0/1026176994 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d740b43f0 0x7f7d740a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f486ffff640 1 librados: starting msgr at 2024-04-09T12:05:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f486ffff640 1 librados: starting objecter 2024-04-09T12:05:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f7d79c49640 1 -- 172.21.15.29:0/1026176994 >> v1:172.21.15.29:6789/0 conn(0x7f7d740b1b90 legacy=0x7f7d740b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f7d79c49640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f7d79c49640 1 monclient: found mon.noname-a 2024-04-09T12:05:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f7d79c49640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f7d79c49640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f7d79c49640 1 -- 172.21.15.29:0/1026176994 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d740aa200 con 0x7f7d74141640 2024-04-09T12:05:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f35a5ad9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f35a5ad9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f35a5ad9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f486ffff640 1 Processor -- start 2024-04-09T12:05:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f486ffff640 1 -- start start 2024-04-09T12:05:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f486ffff640 1 librados: setting wanted keys 2024-04-09T12:05:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f486ffff640 1 librados: calling monclient init 2024-04-09T12:05:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.555+0000 7f486ffff640 10 monclient: init 2024-04-09T12:05:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 1 -- 172.21.15.29:0/474244741 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d402cbc0 con 0x7f03dc0af350 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 10 monclient: dump: 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 1 -- 172.21.15.29:0/474244741 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d402cd20 con 0x7f03dc0af350 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 1 -- 172.21.15.29:0/474244741 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d4034660 con 0x7f03dc0af350 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03daffd640 10 monclient: dump: 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.597 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4868036480 0x7f486802f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f4868036480 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4868038d70 0x7f48680cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f4868038d70 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48680cab50 0x7f486815cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f48680cab50 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48680cbd60 con 0x7f4868038d70 2024-04-09T12:05:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48680cb060 con 0x7f4868036480 2024-04-09T12:05:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48680cb300 con 0x7f48680cab50 2024-04-09T12:05:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f486ffff640 10 monclient(hunting): authenticate will time out at 1390.676258s 2024-04-09T12:05:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03e1024640 5 monclient: authenticate success, global_id 4262 2024-04-09T12:05:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03e1024640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7f03e1024640 4 set_mon_vals no callback set 2024-04-09T12:05:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.556+0000 7fa7bffff640 1 --2- 172.21.15.29:0/932558925 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c013e710 0x7fa7c013eb70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac009870 tx=0x7fa7ac02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cabc4ea276af42eb server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f03e1024640 10 monclient: shutdown 2024-04-09T12:05:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 1 -- 172.21.15.29:0/1761854981 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8402c960 con 0x7f6f8c071750 2024-04-09T12:05:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f03e1024640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:24.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 10 monclient: dump: 2024-04-09T12:05:24.601 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.601 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.601 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.602 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f03e1024640 1 -- 172.21.15.29:0/474244741 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f03dc0af350 msgr2=0x7f03dc141510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f03e1024640 1 --2- 172.21.15.29:0/474244741 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f03dc0af350 0x7f03dc141510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009d90 tx=0x7f03d402be10 comp rx=0 tx=0).stop 2024-04-09T12:05:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f03e1024640 1 -- 172.21.15.29:0/474244741 shutdown_connections 2024-04-09T12:05:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f03e1024640 1 --2- 172.21.15.29:0/474244741 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f03dc0af350 0x7f03dc141510 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f03e1024640 1 --2- 172.21.15.29:0/474244741 >> v2:172.21.15.29:3300/0 conn(0x7f03dc0acc60 0x7f03dc071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f03e1024640 1 -- 172.21.15.29:0/474244741 >> 172.21.15.29:0/474244741 conn(0x7f03dc0b2c80 msgr2=0x7f03dc0b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f03e1024640 1 -- 172.21.15.29:0/474244741 shutdown_connections 2024-04-09T12:05:24.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f03e1024640 1 -- 172.21.15.29:0/474244741 wait complete. 2024-04-09T12:05:24.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 1 -- 172.21.15.29:0/1761854981 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8402cac0 con 0x7f6f8c071750 2024-04-09T12:05:24.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 1 -- 172.21.15.29:0/1761854981 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8402ce50 con 0x7f6f8c071750 2024-04-09T12:05:24.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:24.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f83fff640 10 monclient: dump: 2024-04-09T12:05:24.605 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f938dc640 5 monclient: authenticate success, global_id 4333 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f938dc640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.557+0000 7f6f938dc640 4 set_mon_vals no callback set 2024-04-09T12:05:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f03e1024640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f03e1024640 10 monclient: monmap: 2024-04-09T12:05:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:24.608 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f6f938dc640 10 monclient: shutdown 2024-04-09T12:05:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f6f938dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f6f938dc640 1 -- 172.21.15.29:0/1761854981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f8c071750 msgr2=0x7f6f8c145f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f6f938dc640 1 --2- 172.21.15.29:0/1761854981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f8c071750 0x7f6f8c145f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c06f320 tx=0x7f6f8402bdc0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f6f938dc640 1 -- 172.21.15.29:0/1761854981 shutdown_connections 2024-04-09T12:05:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f6f938dc640 1 --2- 172.21.15.29:0/1761854981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f8c071750 0x7f6f8c145f10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f6f938dc640 1 --2- 172.21.15.29:0/1761854981 >> v2:172.21.15.29:3300/0 conn(0x7f6f8c065d80 0x7f6f8c1459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f6f938dc640 1 -- 172.21.15.29:0/1761854981 >> 172.21.15.29:0/1761854981 conn(0x7f6f8c0b3d90 msgr2=0x7f6f8c0b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f03e1024640 1 librados: starting msgr at 2024-04-09T12:05:24.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f03e1024640 1 librados: starting objecter 2024-04-09T12:05:24.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f6f938dc640 1 -- 172.21.15.29:0/1761854981 shutdown_connections 2024-04-09T12:05:24.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f6f938dc640 1 -- 172.21.15.29:0/1761854981 wait complete. 2024-04-09T12:05:24.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f03e1024640 1 Processor -- start 2024-04-09T12:05:24.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f03e1024640 1 -- start start 2024-04-09T12:05:24.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f03e1024640 1 librados: setting wanted keys 2024-04-09T12:05:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f03e1024640 1 librados: calling monclient init 2024-04-09T12:05:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.558+0000 7f03e1024640 10 monclient: init 2024-04-09T12:05:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f6f938dc640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f6f938dc640 10 monclient: monmap: 2024-04-09T12:05:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.613 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:24.613 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:24.613 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:24.613 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:05:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc0ac880 0x7f03dc13c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 10 monclient(hunting): picked mon.noname-b con 0x7f03dc0ac880 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f03dc0af350 0x7f03dc1360f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 10 monclient(hunting): picked mon.noname-c con 0x7f03dc0af350 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03dc13ccf0 0x7f03dc136630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 10 monclient(hunting): picked mon.noname-a con 0x7f03dc13ccf0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc13d330 con 0x7f03dc13ccf0 2024-04-09T12:05:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc13e6b0 con 0x7f03dc0ac880 2024-04-09T12:05:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc136b70 con 0x7f03dc0af350 2024-04-09T12:05:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.559+0000 7f03e1024640 10 monclient(hunting): authenticate will time out at 1390.679843s 2024-04-09T12:05:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f35a5ad9640 10 monclient(hunting): handle_auth_done global_id 4342 payload 274 2024-04-09T12:05:24.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f6f938dc640 1 librados: starting msgr at 2024-04-09T12:05:24.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f6f938dc640 1 librados: starting objecter 2024-04-09T12:05:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f35a5ad9640 1 -- 172.21.15.29:0/1148779603 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35980c3130 msgr2=0x7f35980c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f35a5ad9640 1 --2- 172.21.15.29:0/1148779603 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35980c3130 0x7f35980c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f35a5ad9640 1 -- 172.21.15.29:0/1148779603 >> v1:172.21.15.173:6789/0 conn(0x7f35980355b0 legacy=0x7f35980c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f35a5ad9640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f35a5ad9640 1 monclient: found mon.noname-c 2024-04-09T12:05:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f35a5ad9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f35a5ad9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f35a5ad9640 1 -- 172.21.15.29:0/1148779603 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359802e990 con 0x7f3598036df0 2024-04-09T12:05:24.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f6f938dc640 1 Processor -- start 2024-04-09T12:05:24.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f6f938dc640 1 -- start start 2024-04-09T12:05:24.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f6f938dc640 1 librados: setting wanted keys 2024-04-09T12:05:24.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f6f938dc640 1 librados: calling monclient init 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.560+0000 7f6f938dc640 10 monclient: init 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f8c065d80 0x7f6f8c1cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 10 monclient(hunting): picked mon.noname-b con 0x7f6f8c065d80 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c071750 0x7f6f8c0adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 10 monclient(hunting): picked mon.noname-a con 0x7f6f8c071750 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6f8c0ae790 0x7f6f8c1cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 10 monclient(hunting): picked mon.noname-c con 0x7f6f8c0ae790 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c1cd430 con 0x7f6f8c071750 2024-04-09T12:05:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c1cbb70 con 0x7f6f8c065d80 2024-04-09T12:05:24.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c1ccef0 con 0x7f6f8c0ae790 2024-04-09T12:05:24.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7f6f938dc640 10 monclient(hunting): authenticate will time out at 1390.681412s 2024-04-09T12:05:24.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 1 -- 172.21.15.29:0/922054771 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c02d040 con 0x7fdc7013e970 2024-04-09T12:05:24.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 10 monclient: dump: 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc76b91640 5 monclient: authenticate success, global_id 4339 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc76b91640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 1 -- 172.21.15.29:0/922054771 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c031810 con 0x7fdc7013e970 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 1 -- 172.21.15.29:0/922054771 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c031ba0 con 0x7fdc7013e970 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc6f7fe640 10 monclient: dump: 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc76b91640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.561+0000 7fdc76b91640 4 set_mon_vals no callback set 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.562+0000 7fdc76b91640 10 monclient: shutdown 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.562+0000 7fdc76b91640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.562+0000 7fdc76b91640 1 -- 172.21.15.29:0/922054771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc7013e970 msgr2=0x7fdc7013edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.562+0000 7fdc76b91640 1 --2- 172.21.15.29:0/922054771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc7013e970 0x7fdc7013edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0097d0 tx=0x7fdc5c02b8b0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.562+0000 7fdc76b91640 1 -- 172.21.15.29:0/922054771 shutdown_connections 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.562+0000 7fdc76b91640 1 --2- 172.21.15.29:0/922054771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc7013e970 0x7fdc7013edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.562+0000 7fdc76b91640 1 --2- 172.21.15.29:0/922054771 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdc700b43d0 0x7fdc700a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.562+0000 7fdc76b91640 1 -- 172.21.15.29:0/922054771 >> 172.21.15.29:0/922054771 conn(0x7fdc70065f30 msgr2=0x7fdc70066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.562+0000 7fdc76b91640 1 -- 172.21.15.29:0/922054771 shutdown_connections 2024-04-09T12:05:24.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.562+0000 7fdc76b91640 1 -- 172.21.15.29:0/922054771 wait complete. 2024-04-09T12:05:24.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.563+0000 7f7d79c49640 1 --2- 172.21.15.29:0/1026176994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d74141640 0x7f7d74141a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009870 tx=0x7f7d6402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b2a43059aa5b95 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.563+0000 7f35a5ad9640 1 --2- 172.21.15.29:0/1148779603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598036df0 0x7f35980c2bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f359c0097a0 tx=0x7f359c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40b5a6d928e48eb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.563+0000 7fdc76b91640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.563+0000 7fdc76b91640 10 monclient: monmap: 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:24.627 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.563+0000 7f486f7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48680cab50 0x7f486815cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7fdc76b91640 1 librados: starting msgr at 2024-04-09T12:05:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7fdc76b91640 1 librados: starting objecter 2024-04-09T12:05:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7fdc76b91640 1 Processor -- start 2024-04-09T12:05:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7fdc76b91640 1 -- start start 2024-04-09T12:05:24.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7fdc76b91640 1 librados: setting wanted keys 2024-04-09T12:05:24.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7fdc76b91640 1 librados: calling monclient init 2024-04-09T12:05:24.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7fdc76b91640 10 monclient: init 2024-04-09T12:05:24.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1d544640 1 -- 172.21.15.29:0/2770396351 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08030c40 con 0x7f8c1806d950 2024-04-09T12:05:24.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1d544640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1d544640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1d544640 10 monclient: dump: 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1d544640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1d544640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1d544640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1f548640 5 monclient: authenticate success, global_id 4259 2024-04-09T12:05:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1d544640 1 -- 172.21.15.29:0/2770396351 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c08030da0 con 0x7f8c1806d950 2024-04-09T12:05:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1f548640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1d544640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1f548640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.564+0000 7f8c1f548640 4 set_mon_vals no callback set 2024-04-09T12:05:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f486f7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48680cab50 0x7f486815cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39264/0 (socket says 172.21.15.29:39264) 2024-04-09T12:05:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f486f7fe640 1 -- 172.21.15.29:0/3339658195 learned_addr learned my addr 172.21.15.29:0/3339658195 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f486f7fe640 10 monclient(hunting): get_auth_request con 0x7f48680cab50 auth_method 0 2024-04-09T12:05:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f486f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f486f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f486f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1f548640 10 monclient: shutdown 2024-04-09T12:05:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1f548640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1f548640 1 -- 172.21.15.29:0/2770396351 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 msgr2=0x7f8c1806e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1d544640 1 -- 172.21.15.29:0/2770396351 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08030c40 con 0x7f8c1806d950 2024-04-09T12:05:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1f548640 1 --2- 172.21.15.29:0/2770396351 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 0x7f8c1806e500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8c08009870 tx=0x7f8c0802fe90 comp rx=0 tx=0).stop 2024-04-09T12:05:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1d544640 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2024-04-09T12:05:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1f548640 1 -- 172.21.15.29:0/2770396351 shutdown_connections 2024-04-09T12:05:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1f548640 1 --2- 172.21.15.29:0/2770396351 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 0x7f8c1806e500 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1f548640 1 --2- 172.21.15.29:0/2770396351 >> v2:172.21.15.29:3300/0 conn(0x7f8c1806bd40 0x7f8c18070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1f548640 1 -- 172.21.15.29:0/2770396351 >> 172.21.15.29:0/2770396351 conn(0x7f8c180b30a0 msgr2=0x7f8c180b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc700b43d0 0x7fdc70137f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 10 monclient(hunting): picked mon.noname-b con 0x7fdc700b43d0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc7013e970 0x7fdc70134990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 10 monclient(hunting): picked mon.noname-a con 0x7fdc7013e970 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdc70144c50 0x7fdc701d62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 10 monclient(hunting): picked mon.noname-c con 0x7fdc70144c50 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc70136b50 con 0x7fdc7013e970 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc70137120 con 0x7fdc700b43d0 2024-04-09T12:05:24.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc70134390 con 0x7fdc70144c50 2024-04-09T12:05:24.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7fdc76b91640 10 monclient(hunting): authenticate will time out at 1390.685568s 2024-04-09T12:05:24.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1f548640 1 -- 172.21.15.29:0/2770396351 shutdown_connections 2024-04-09T12:05:24.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.565+0000 7f8c1f548640 1 -- 172.21.15.29:0/2770396351 wait complete. 2024-04-09T12:05:24.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f486f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f486f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f486f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f8c1f548640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f8c1f548640 10 monclient: monmap: 2024-04-09T12:05:24.636 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.636 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:24.636 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:24.636 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:24.636 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:24.637 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 1 -- 172.21.15.29:0/932558925 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0317c0 con 0x7fa7c013e710 2024-04-09T12:05:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:24.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f8c1f548640 1 librados: starting msgr at 2024-04-09T12:05:24.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f8c1f548640 1 librados: starting objecter 2024-04-09T12:05:24.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 10 monclient: dump: 2024-04-09T12:05:24.638 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.638 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.638 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.638 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 1 -- 172.21.15.29:0/932558925 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac031920 con 0x7fa7c013e710 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7c6d47640 5 monclient: authenticate success, global_id 4268 2024-04-09T12:05:24.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 1 -- 172.21.15.29:0/932558925 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac031cb0 con 0x7fa7c013e710 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7bf7fe640 10 monclient: dump: 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7c6d47640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:24.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7fa7c6d47640 4 set_mon_vals no callback set 2024-04-09T12:05:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f8c1f548640 1 Processor -- start 2024-04-09T12:05:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f8c1f548640 1 -- start start 2024-04-09T12:05:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f8c1f548640 1 librados: setting wanted keys 2024-04-09T12:05:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f8c1f548640 1 librados: calling monclient init 2024-04-09T12:05:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.566+0000 7f8c1f548640 10 monclient: init 2024-04-09T12:05:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-09T12:05:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c1806bd40 0x7f8c181d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 10 monclient(hunting): picked mon.noname-a con 0x7f8c1806bd40 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 0x7f8c181d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 10 monclient(hunting): picked mon.noname-c con 0x7f8c1806d950 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c1806ea40 0x7f8c1813c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 10 monclient(hunting): picked mon.noname-b con 0x7f8c1806ea40 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180acf80 con 0x7f8c1806bd40 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c181d2180 con 0x7f8c1806ea40 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180ab1b0 con 0x7f8c1806d950 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7f8c1f548640 10 monclient(hunting): authenticate will time out at 1390.687455s 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7fa7c6d47640 10 monclient: shutdown 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7fa7c6d47640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7fa7c6d47640 1 -- 172.21.15.29:0/932558925 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c013e710 msgr2=0x7fa7c013eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7fa7c6d47640 1 --2- 172.21.15.29:0/932558925 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c013e710 0x7fa7c013eb70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac009870 tx=0x7fa7ac02b860 comp rx=0 tx=0).stop 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7fa7c6d47640 1 -- 172.21.15.29:0/932558925 shutdown_connections 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7fa7c6d47640 1 --2- 172.21.15.29:0/932558925 >> v2:172.21.15.29:3300/0 conn(0x7fa7c0144ad0 0x7fa7c0144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7fa7c6d47640 1 --2- 172.21.15.29:0/932558925 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c013e710 0x7fa7c013eb70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7fa7c6d47640 1 -- 172.21.15.29:0/932558925 >> 172.21.15.29:0/932558925 conn(0x7fa7c0065cf0 msgr2=0x7fa7c0066100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7fa7c6d47640 1 -- 172.21.15.29:0/932558925 shutdown_connections 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.567+0000 7fa7c6d47640 1 -- 172.21.15.29:0/932558925 wait complete. 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.568+0000 7fa7c6d47640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.568+0000 7fa7c6d47640 10 monclient: monmap: 2024-04-09T12:05:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:24.646 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.568+0000 7f486effd640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4868036480 0x7f486802f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.568+0000 7fa7c6d47640 1 librados: starting msgr at 2024-04-09T12:05:24.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.568+0000 7fa7c6d47640 1 librados: starting objecter 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.568+0000 7fa7c6d47640 1 Processor -- start 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.568+0000 7fa7c6d47640 1 -- start start 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.568+0000 7fa7c6d47640 1 librados: setting wanted keys 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.568+0000 7fa7c6d47640 1 librados: calling monclient init 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.568+0000 7fa7c6d47640 10 monclient: init 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c00b4070 0x7fa7c0137c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 10 monclient(hunting): picked mon.noname-c con 0x7fa7c00b4070 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7c013e710 0x7fa7c01db000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 10 monclient(hunting): picked mon.noname-b con 0x7fa7c013e710 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7c0144ad0 0x7fa7c01db540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 10 monclient(hunting): picked mon.noname-a con 0x7fa7c0144ad0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:24.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00b6220 con 0x7fa7c0144ad0 2024-04-09T12:05:24.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00b63b0 con 0x7fa7c013e710 2024-04-09T12:05:24.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00b5840 con 0x7fa7c00b4070 2024-04-09T12:05:24.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.569+0000 7fa7c6d47640 10 monclient(hunting): authenticate will time out at 1390.689747s 2024-04-09T12:05:24.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486effd640 10 monclient(hunting): get_auth_request con 0x7f4868036480 auth_method 0 2024-04-09T12:05:24.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486effd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486f7fe640 10 monclient(hunting): handle_auth_done global_id 4271 payload 824 2024-04-09T12:05:24.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486f7fe640 1 -- 172.21.15.29:0/3339658195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4868036480 msgr2=0x7f486802f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486f7fe640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4868036480 0x7f486802f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486f7fe640 1 -- 172.21.15.29:0/3339658195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4868038d70 msgr2=0x7f48680cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486f7fe640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4868038d70 0x7f48680cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486f7fe640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486f7fe640 1 monclient: found mon.noname-c 2024-04-09T12:05:24.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.570+0000 7f486f7fe640 1 -- 172.21.15.29:0/3339658195 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48640094d0 con 0x7f48680cab50 2024-04-09T12:05:24.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.571+0000 7f6f91678640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f8c065d80 0x7f6f8c1cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.574+0000 7f486f7fe640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48680cab50 0x7f486815cdc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4870069870 tx=0x7f4870067180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.574+0000 7f48577fe640 10 client.?.objecter ms_handle_connect 0x7f48680cab50 2024-04-09T12:05:24.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.574+0000 7f48577fe640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:24.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.574+0000 7f6f91678640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f8c065d80 0x7f6f8c1cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:41032/0 (socket says 172.21.15.29:41032) 2024-04-09T12:05:24.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f6f91678640 1 -- 172.21.15.29:0/1614127035 learned_addr learned my addr 172.21.15.29:0/1614127035 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f6f91678640 10 monclient(hunting): get_auth_request con 0x7f6f8c065d80 auth_method 0 2024-04-09T12:05:24.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f6f91678640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f6f91678640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f6f91678640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f03dbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc0ac880 0x7f03dc13c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 1 -- 172.21.15.29:0/1026176994 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64030840 con 0x7f7d74141640 2024-04-09T12:05:24.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:24.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 10 monclient: dump: 2024-04-09T12:05:24.656 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.656 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.656 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.656 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.656 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.656 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.657 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.657 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.657 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.657 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f6f91678640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f6f91678640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f6f91678640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 1 -- 172.21.15.29:0/1026176994 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d640309a0 con 0x7f7d74141640 2024-04-09T12:05:24.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d7c6ae640 5 monclient: authenticate success, global_id 4281 2024-04-09T12:05:24.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d7c6ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:24.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d7c6ae640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:24.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d7c6ae640 4 set_mon_vals no callback set 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 1 -- 172.21.15.29:0/1026176994 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64030d30 con 0x7f7d74141640 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f7d79448640 10 monclient: dump: 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.659 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.575+0000 7f6f91e79640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6f8c0ae790 0x7f6f8c1cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f03dbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc0ac880 0x7f03dc13c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:41022/0 (socket says 172.21.15.29:41022) 2024-04-09T12:05:24.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f03dbfff640 1 -- 172.21.15.29:0/131164824 learned_addr learned my addr 172.21.15.29:0/131164824 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f03dbfff640 10 monclient(hunting): get_auth_request con 0x7f03dc0ac880 auth_method 0 2024-04-09T12:05:24.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f03dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f03dbfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f03dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f7d7c6ae640 10 monclient: shutdown 2024-04-09T12:05:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f7d7c6ae640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/1026176994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d74141640 msgr2=0x7f7d74141a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f7d7c6ae640 1 --2- 172.21.15.29:0/1026176994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d74141640 0x7f7d74141a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009870 tx=0x7f7d6402b980 comp rx=0 tx=0).stop 2024-04-09T12:05:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/1026176994 shutdown_connections 2024-04-09T12:05:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f7d7c6ae640 1 --2- 172.21.15.29:0/1026176994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d74141640 0x7f7d74141a80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f7d7c6ae640 1 --2- 172.21.15.29:0/1026176994 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d740b43f0 0x7f7d740a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/1026176994 >> 172.21.15.29:0/1026176994 conn(0x7f7d74065f30 msgr2=0x7f7d74066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/1026176994 shutdown_connections 2024-04-09T12:05:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.576+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/1026176994 wait complete. 2024-04-09T12:05:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f6f91e79640 10 monclient(hunting): get_auth_request con 0x7f6f8c0ae790 auth_method 0 2024-04-09T12:05:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f6f91e79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f6f91e79640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f6f91e79640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f7d7c6ae640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f7d7c6ae640 10 monclient: monmap: 2024-04-09T12:05:24.664 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.664 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f7d7c6ae640 1 librados: starting msgr at 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f7d7c6ae640 1 librados: starting objecter 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f7d7c6ae640 1 Processor -- start 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f7d7c6ae640 1 -- start start 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f7d7c6ae640 1 librados: setting wanted keys 2024-04-09T12:05:24.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f7d7c6ae640 1 librados: calling monclient init 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.577+0000 7f7d7c6ae640 10 monclient: init 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d740b1b90 0x7f7d7406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 10 monclient(hunting): picked mon.noname-b con 0x7f7d740b1b90 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d740b43f0 0x7f7d741db000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 10 monclient(hunting): picked mon.noname-c con 0x7f7d740b43f0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d74141640 0x7f7d741db540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 10 monclient(hunting): picked mon.noname-a con 0x7f7d74141640 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740ac190 con 0x7f7d74141640 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7406c020 con 0x7f7d740b1b90 2024-04-09T12:05:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d741dba80 con 0x7f7d740b43f0 2024-04-09T12:05:24.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f7d7c6ae640 10 monclient(hunting): authenticate will time out at 1390.698533s 2024-04-09T12:05:24.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f6f91678640 10 monclient(hunting): handle_auth_done global_id 4351 payload 824 2024-04-09T12:05:24.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f6f91678640 1 -- 172.21.15.29:0/1614127035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6f8c0ae790 msgr2=0x7f6f8c1cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f6f91678640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6f8c0ae790 0x7f6f8c1cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f6f91678640 1 -- 172.21.15.29:0/1614127035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c071750 msgr2=0x7f6f8c0adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f6f91678640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c071750 0x7f6f8c0adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f6f91678640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f6f91678640 1 monclient: found mon.noname-b 2024-04-09T12:05:24.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f6f91678640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f6f91678640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7f6f91678640 1 -- 172.21.15.29:0/1614127035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f84009b30 con 0x7f6f8c065d80 2024-04-09T12:05:24.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.578+0000 7fdc7492d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc700b43d0 0x7fdc70137f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.579+0000 7f03e0823640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03dc13ccf0 0x7f03dc136630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.579+0000 7fdc7512e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdc70144c50 0x7fdc701d62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7fdc7512e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdc70144c50 0x7fdc701d62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39278/0 (socket says 172.21.15.29:39278) 2024-04-09T12:05:24.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7fdc7512e640 1 -- 172.21.15.29:0/3890621766 learned_addr learned my addr 172.21.15.29:0/3890621766 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7fdc7512e640 10 monclient(hunting): get_auth_request con 0x7fdc70144c50 auth_method 0 2024-04-09T12:05:24.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7fdc7512e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7fdc7512e640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7fdc7512e640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7f03e0823640 10 monclient(hunting): get_auth_request con 0x7f03dc13ccf0 auth_method 0 2024-04-09T12:05:24.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7f03e0823640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7f03e0823640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7f03e0823640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7fdc7492d640 10 monclient(hunting): get_auth_request con 0x7fdc700b43d0 auth_method 0 2024-04-09T12:05:24.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7fdc7492d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7fdc7492d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.580+0000 7fdc7492d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7f03db7fe640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f03dc0af350 0x7f03dc1360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7fdc7512e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7fdc7512e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7fdc7512e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7f03dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7f03dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7f03dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7f03e0823640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7f03e0823640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7f03e0823640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7fdc7492d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7fdc7492d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.581+0000 7fdc7492d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.582+0000 7f6f91678640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f8c065d80 0x7f6f8c1cd880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800e9b0 tx=0x7f6f8800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.582+0000 7f6f81ffb640 10 client.?.objecter ms_handle_connect 0x7f6f8c065d80 2024-04-09T12:05:24.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.582+0000 7f6f81ffb640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:24.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.582+0000 7f8c1dd45640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 0x7f8c181d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.584+0000 7f03dbfff640 10 monclient(hunting): handle_auth_done global_id 4354 payload 824 2024-04-09T12:05:24.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.585+0000 7f03dbfff640 1 -- 172.21.15.29:0/131164824 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f03dc0af350 msgr2=0x7f03dc1360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.585+0000 7f03dbfff640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f03dc0af350 0x7f03dc1360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.585+0000 7f03dbfff640 1 -- 172.21.15.29:0/131164824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03dc13ccf0 msgr2=0x7f03dc136630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.585+0000 7f03dbfff640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03dc13ccf0 0x7f03dc136630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.585+0000 7f03dbfff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.585+0000 7f03dbfff640 1 monclient: found mon.noname-b 2024-04-09T12:05:24.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.585+0000 7f03dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.585+0000 7f03dbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.585+0000 7f03dbfff640 1 -- 172.21.15.29:0/131164824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d4009a70 con 0x7f03dc0ac880 2024-04-09T12:05:24.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.587+0000 7fdc6ffff640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc7013e970 0x7fdc70134990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.588+0000 7fdc7512e640 10 monclient(hunting): handle_auth_done global_id 4277 payload 824 2024-04-09T12:05:24.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.588+0000 7fdc7512e640 1 -- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc700b43d0 msgr2=0x7fdc70137f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.588+0000 7fdc7512e640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc700b43d0 0x7fdc70137f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.588+0000 7fdc7512e640 1 -- 172.21.15.29:0/3890621766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc7013e970 msgr2=0x7fdc70134990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.588+0000 7fdc7512e640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc7013e970 0x7fdc70134990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.588+0000 7fdc7512e640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.588+0000 7fdc7512e640 1 monclient: found mon.noname-c 2024-04-09T12:05:24.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.588+0000 7fdc7512e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.588+0000 7fdc7512e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.588+0000 7fdc7512e640 1 -- 172.21.15.29:0/3890621766 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c009400 con 0x7fdc70144c50 2024-04-09T12:05:24.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.588+0000 7f8c1e546640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c1806bd40 0x7f8c181d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.589+0000 7f8c1dd45640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 0x7f8c181d2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39282/0 (socket says 172.21.15.29:39282) 2024-04-09T12:05:24.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.589+0000 7f8c1dd45640 1 -- 172.21.15.29:0/774075054 learned_addr learned my addr 172.21.15.29:0/774075054 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.589+0000 7f8c1dd45640 10 monclient(hunting): get_auth_request con 0x7f8c1806d950 auth_method 0 2024-04-09T12:05:24.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.589+0000 7f8c1dd45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.589+0000 7f8c1dd45640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.589+0000 7f8c1dd45640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.590+0000 7f8c1e546640 10 monclient(hunting): get_auth_request con 0x7f8c1806bd40 auth_method 0 2024-04-09T12:05:24.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.590+0000 7f8c1e546640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.590+0000 7f8c1e546640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.590+0000 7f8c1e546640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.590+0000 7f8c1e546640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.590+0000 7f8c1e546640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.590+0000 7f8c1e546640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.591+0000 7fa7c4ae3640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c00b4070 0x7fa7c0137c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.591+0000 7fa7c52e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7c0144ad0 0x7fa7c01db540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.591+0000 7f7d7ac4b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d74141640 0x7f7d741db540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.591+0000 7f03dbfff640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc0ac880 0x7f03dc13c4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f03cc00c480 tx=0x7f03cc00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.591+0000 7f03d8ff9640 10 client.?.objecter ms_handle_connect 0x7f03dc0ac880 2024-04-09T12:05:24.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.591+0000 7f03d8ff9640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:24.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.591+0000 7f8c1dd45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.591+0000 7f8c1dd45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.591+0000 7f8c1dd45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7fa7c4ae3640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c00b4070 0x7fa7c0137c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39298/0 (socket says 172.21.15.29:39298) 2024-04-09T12:05:24.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7fa7c4ae3640 1 -- 172.21.15.29:0/1424952199 learned_addr learned my addr 172.21.15.29:0/1424952199 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7fa7c4ae3640 10 monclient(hunting): get_auth_request con 0x7fa7c00b4070 auth_method 0 2024-04-09T12:05:24.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7fa7c4ae3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7fa7c4ae3640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7fa7c4ae3640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 1 -- 172.21.15.29:0/1148779603 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c031830 con 0x7f3598036df0 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 10 monclient: dump: 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 1 -- 172.21.15.29:0/1148779603 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c031990 con 0x7f3598036df0 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a6adb640 5 monclient: authenticate success, global_id 4342 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 1 -- 172.21.15.29:0/1148779603 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c031d20 con 0x7f3598036df0 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a4ad7640 10 monclient: dump: 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a6adb640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.592+0000 7f35a6adb640 4 set_mon_vals no callback set 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.593+0000 7f35a6adb640 10 monclient: shutdown 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.593+0000 7f35a6adb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.593+0000 7f35a6adb640 1 -- 172.21.15.29:0/1148779603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598036df0 msgr2=0x7f35980c2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.593+0000 7f35a6adb640 1 --2- 172.21.15.29:0/1148779603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598036df0 0x7f35980c2bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f359c0097a0 tx=0x7f359c02b8d0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.593+0000 7f35a6adb640 1 -- 172.21.15.29:0/1148779603 shutdown_connections 2024-04-09T12:05:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.593+0000 7f35a6adb640 1 --2- 172.21.15.29:0/1148779603 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35980c3130 0x7f35980c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.593+0000 7f35a6adb640 1 --2- 172.21.15.29:0/1148779603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598036df0 0x7f35980c2bf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.593+0000 7f35a6adb640 1 -- 172.21.15.29:0/1148779603 >> 172.21.15.29:0/1148779603 conn(0x7f3598006390 msgr2=0x7f35980067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.593+0000 7f35a6adb640 1 -- 172.21.15.29:0/1148779603 shutdown_connections 2024-04-09T12:05:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.593+0000 7f35a6adb640 1 -- 172.21.15.29:0/1148779603 wait complete. 2024-04-09T12:05:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.593+0000 7f8c1ed47640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c1806ea40 0x7f8c1813c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f35a6adb640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f35a6adb640 10 monclient: monmap: 2024-04-09T12:05:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:24.689 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:24.689 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:24.689 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f8c1e546640 10 monclient(hunting): handle_auth_done global_id 4287 payload 824 2024-04-09T12:05:24.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f8c1e546640 1 -- 172.21.15.29:0/774075054 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 msgr2=0x7f8c181d2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f8c1e546640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c1806d950 0x7f8c181d2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f8c1e546640 1 -- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c1806ea40 msgr2=0x7f8c1813c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f8c1e546640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c1806ea40 0x7f8c1813c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f8c1e546640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f8c1e546640 1 monclient: found mon.noname-a 2024-04-09T12:05:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f8c1e546640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f8c1e546640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f8c1e546640 1 -- 172.21.15.29:0/774075054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c080094d0 con 0x7f8c1806bd40 2024-04-09T12:05:24.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f35a6adb640 1 librados: starting msgr at 2024-04-09T12:05:24.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f35a6adb640 1 librados: starting objecter 2024-04-09T12:05:24.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f35a6adb640 1 Processor -- start 2024-04-09T12:05:24.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f35a6adb640 1 -- start start 2024-04-09T12:05:24.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f35a6adb640 1 librados: setting wanted keys 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f35a6adb640 1 librados: calling monclient init 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.594+0000 7f35a6adb640 10 monclient: init 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35980355b0 0x7f35980c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 10 monclient(hunting): picked mon.noname-b con 0x7f35980355b0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3598036df0 0x7f35980c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 10 monclient(hunting): picked mon.noname-a con 0x7f3598036df0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35980c3130 0x7f35980332a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 10 monclient(hunting): picked mon.noname-c con 0x7f35980c3130 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35980092f0 con 0x7f3598036df0 2024-04-09T12:05:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35980c6f30 con 0x7f35980355b0 2024-04-09T12:05:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35980c7210 con 0x7f35980c3130 2024-04-09T12:05:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.595+0000 7f35a6adb640 10 monclient(hunting): authenticate will time out at 1390.715819s 2024-04-09T12:05:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7f7d7ac4b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d74141640 0x7f7d741db540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48100/0 (socket says 172.21.15.29:48100) 2024-04-09T12:05:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7f7d7ac4b640 1 -- 172.21.15.29:0/864306481 learned_addr learned my addr 172.21.15.29:0/864306481 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7f7d7ac4b640 10 monclient(hunting): get_auth_request con 0x7f7d74141640 auth_method 0 2024-04-09T12:05:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7f7d7ac4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7f7d7ac4b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7f7d7ac4b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7fa7c52e4640 10 monclient(hunting): get_auth_request con 0x7fa7c0144ad0 auth_method 0 2024-04-09T12:05:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7fa7c52e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7fa7c52e4640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7fa7c52e4640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7fdc7512e640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdc70144c50 0x7fdc701d62e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800ca80 tx=0x7fdc6800cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7fdc6d7fa640 10 client.?.objecter ms_handle_connect 0x7fdc70144c50 2024-04-09T12:05:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.596+0000 7fdc6d7fa640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:24.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.598+0000 7fa7c52e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.598+0000 7fa7c52e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.598+0000 7fa7c52e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.598+0000 7fa7c4ae3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.598+0000 7fa7c4ae3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.598+0000 7fa7c4ae3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.598+0000 7f8c1e546640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c1806bd40 0x7f8c181d26a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000cc10 tx=0x7f8c1000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.598+0000 7f8c0effd640 10 client.?.objecter ms_handle_connect 0x7f8c1806bd40 2024-04-09T12:05:24.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.598+0000 7f8c0effd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:24.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.599+0000 7f7d7ac4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.599+0000 7f7d7ac4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.599+0000 7f7d7ac4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.599+0000 7fa7bffff640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7c013e710 0x7fa7c01db000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.600+0000 7fa7bffff640 10 monclient(hunting): get_auth_request con 0x7fa7c013e710 auth_method 0 2024-04-09T12:05:24.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.600+0000 7fa7bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.600+0000 7fa7bffff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.600+0000 7fa7bffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7fa7bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7fa7bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7fa7bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 1 -- 172.21.15.29:0/1614127035 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88009670 con 0x7f6f8c065d80 2024-04-09T12:05:24.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:24.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 10 monclient: dump: 2024-04-09T12:05:24.701 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.701 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.701 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.701 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.701 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.701 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.701 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.702 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.702 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.702 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 1 -- 172.21.15.29:0/1614127035 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8800c9a0 con 0x7f6f8c065d80 2024-04-09T12:05:24.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 1 -- 172.21.15.29:0/1614127035 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800cd50 con 0x7f6f8c065d80 2024-04-09T12:05:24.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f81ffb640 10 monclient: dump: 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f837fe640 4 set_mon_vals no callback set 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f938dc640 5 monclient: authenticate success, global_id 4351 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f938dc640 10 monclient: _renew_subs 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f938dc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.601+0000 7f6f938dc640 1 -- 172.21.15.29:0/1614127035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c1daa20 con 0x7f6f8c065d80 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.602+0000 7f6f938dc640 10 client.4351.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.602+0000 7f6f938dc640 10 monclient: _renew_subs 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.602+0000 7f6f938dc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.602+0000 7f6f938dc640 1 -- 172.21.15.29:0/1614127035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c1daeb0 con 0x7f6f8c065d80 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.602+0000 7f6f938dc640 1 librados: init done 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7f6f938dc640 10 client.4351.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7f6f938dc640 15 client.4351.objecter _session_command_op_assign -1 1 2024-04-09T12:05:24.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7f6f938dc640 20 client.4351.objecter _get_session osd=-1 returning homeless 2024-04-09T12:05:24.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7f6f938dc640 10 client.4351.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7f6f938dc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7f6f938dc640 1 -- 172.21.15.29:0/1614127035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f8c04e160 con 0x7f6f8c065d80 2024-04-09T12:05:24.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7fa7c4ae3640 10 monclient(hunting): handle_auth_done global_id 4283 payload 824 2024-04-09T12:05:24.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7fa7c4ae3640 1 -- 172.21.15.29:0/1424952199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7c013e710 msgr2=0x7fa7c01db000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7fa7c4ae3640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7c013e710 0x7fa7c01db000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7fa7c4ae3640 1 -- 172.21.15.29:0/1424952199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7c0144ad0 msgr2=0x7fa7c01db540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7fa7c4ae3640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7c0144ad0 0x7fa7c01db540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7fa7c4ae3640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7fa7c4ae3640 1 monclient: found mon.noname-c 2024-04-09T12:05:24.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7fa7c4ae3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7fa7c4ae3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.603+0000 7fa7c4ae3640 1 -- 172.21.15.29:0/1424952199 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac0094d0 con 0x7fa7c00b4070 2024-04-09T12:05:24.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f7d7ac4b640 10 monclient(hunting): handle_auth_done global_id 4293 payload 824 2024-04-09T12:05:24.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f7d7ac4b640 1 -- 172.21.15.29:0/864306481 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d740b43f0 msgr2=0x7f7d741db000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f7d7ac4b640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d740b43f0 0x7f7d741db000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f7d7ac4b640 1 -- 172.21.15.29:0/864306481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d740b1b90 msgr2=0x7f7d7406ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f7d7ac4b640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d740b1b90 0x7f7d7406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f7d7ac4b640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f7d7ac4b640 1 monclient: found mon.noname-a 2024-04-09T12:05:24.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f7d7ac4b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f7d7ac4b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:24.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f7d7ac4b640 1 -- 172.21.15.29:0/864306481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d640094d0 con 0x7f7d74141640 2024-04-09T12:05:24.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 1 -- 172.21.15.29:0/774075054 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000ce20 con 0x7f8c1806bd40 2024-04-09T12:05:24.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:24.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 10 monclient: dump: 2024-04-09T12:05:24.709 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.709 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.709 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.709 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.709 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.709 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 1 -- 172.21.15.29:0/774075054 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c10003990 con 0x7f8c1806bd40 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 1 -- 172.21.15.29:0/774075054 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10003d60 con 0x7f8c1806bd40 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c1f548640 5 monclient: authenticate success, global_id 4287 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c1f548640 10 monclient: _renew_subs 2024-04-09T12:05:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c1f548640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c1f548640 1 -- 172.21.15.29:0/774075054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1813b950 con 0x7f8c1806bd40 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c1cd43640 4 set_mon_vals no callback set 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c0effd640 10 monclient: dump: 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c1f548640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c1f548640 10 monclient: _renew_subs 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c1f548640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c1f548640 1 -- 172.21.15.29:0/774075054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1813cd10 con 0x7f8c1806bd40 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.606+0000 7f8c1f548640 1 librados: init done 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f8c1f548640 10 client.4287.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f8c1f548640 15 client.4287.objecter _session_command_op_assign -1 1 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f8c1f548640 20 client.4287.objecter _get_session osd=-1 returning homeless 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f8c1f548640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f8c1f548640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:24.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f8c1f548640 1 -- 172.21.15.29:0/774075054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c1806ee80 con 0x7f8c1806bd40 2024-04-09T12:05:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 1 -- 172.21.15.29:0/131164824 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc005ce0 con 0x7f03dc0ac880 2024-04-09T12:05:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 10 monclient: dump: 2024-04-09T12:05:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 1 -- 172.21.15.29:0/131164824 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc005e40 con 0x7f03dc0ac880 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 1 -- 172.21.15.29:0/131164824 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0072f0 con 0x7f03dc0ac880 2024-04-09T12:05:24.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03d8ff9640 10 monclient: dump: 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03e1024640 5 monclient: authenticate success, global_id 4354 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03e1024640 10 monclient: _renew_subs 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03e1024640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03e1024640 1 -- 172.21.15.29:0/131164824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc0712a0 con 0x7f03dc0ac880 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.607+0000 7f03da7fc640 4 set_mon_vals no callback set 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.608+0000 7f03e1024640 10 client.4354.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.608+0000 7f03e1024640 10 monclient: _renew_subs 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.608+0000 7f03e1024640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.608+0000 7f03e1024640 1 -- 172.21.15.29:0/131164824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc13ca00 con 0x7f03dc0ac880 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.608+0000 7f03e1024640 1 librados: init done 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.609+0000 7f03e1024640 10 client.4354.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.609+0000 7f03e1024640 15 client.4354.objecter _session_command_op_assign -1 1 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.609+0000 7f03e1024640 20 client.4354.objecter _get_session osd=-1 returning homeless 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.609+0000 7f03e1024640 10 client.4354.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.609+0000 7f03e1024640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:24.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.609+0000 7f03e1024640 1 -- 172.21.15.29:0/131164824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03dc071120 con 0x7f03dc0ac880 2024-04-09T12:05:24.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 1 -- 172.21.15.29:0/3890621766 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6800ac30 con 0x7fdc70144c50 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 10 monclient: dump: 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.719 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 1 -- 172.21.15.29:0/3890621766 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6800ad90 con 0x7fdc70144c50 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc76b91640 5 monclient: authenticate success, global_id 4277 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc76b91640 10 monclient: _renew_subs 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc76b91640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc76b91640 1 -- 172.21.15.29:0/3890621766 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc70134ed0 con 0x7fdc70144c50 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 1 -- 172.21.15.29:0/3890621766 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68012600 con 0x7fdc70144c50 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6d7fa640 10 monclient: dump: 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc76b91640 10 client.4277.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc76b91640 10 monclient: _renew_subs 2024-04-09T12:05:24.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc76b91640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc76b91640 1 -- 172.21.15.29:0/3890621766 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc70132290 con 0x7fdc70144c50 2024-04-09T12:05:24.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc76b91640 1 librados: init done 2024-04-09T12:05:24.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.610+0000 7fdc6effd640 4 set_mon_vals no callback set 2024-04-09T12:05:24.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.611+0000 7fdc76b91640 10 client.4277.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:24.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.611+0000 7fdc76b91640 15 client.4277.objecter _session_command_op_assign -1 1 2024-04-09T12:05:24.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.611+0000 7fdc76b91640 20 client.4277.objecter _get_session osd=-1 returning homeless 2024-04-09T12:05:24.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.611+0000 7fdc76b91640 10 client.4277.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.611+0000 7fdc76b91640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.611+0000 7fdc76b91640 1 -- 172.21.15.29:0/3890621766 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc700a9580 con 0x7fdc70144c50 2024-04-09T12:05:24.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.612+0000 7fa7c4ae3640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c00b4070 0x7fa7c0137c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400c410 tx=0x7fa7b400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.612+0000 7fa7bd7fa640 10 client.?.objecter ms_handle_connect 0x7fa7c00b4070 2024-04-09T12:05:24.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.612+0000 7fa7bd7fa640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:24.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 1 -- 172.21.15.29:0/3339658195 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4870069530 con 0x7f48680cab50 2024-04-09T12:05:24.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:24.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 10 monclient: dump: 2024-04-09T12:05:24.724 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.724 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.724 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.724 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.724 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 1 -- 172.21.15.29:0/3339658195 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48700933f0 con 0x7f48680cab50 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 1 -- 172.21.15.29:0/3339658195 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48700937a0 con 0x7f48680cab50 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:24.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f48577fe640 10 monclient: dump: 2024-04-09T12:05:24.726 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.726 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.726 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.726 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.726 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.726 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.726 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.726 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f486ffff640 5 monclient: authenticate success, global_id 4271 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f486ffff640 10 monclient: _renew_subs 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f486ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f486ffff640 1 -- 172.21.15.29:0/3339658195 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48680300f0 con 0x7f48680cab50 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f486d7fa640 4 set_mon_vals no callback set 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f486ffff640 10 client.4271.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f486ffff640 10 monclient: _renew_subs 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f486ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f486ffff640 1 -- 172.21.15.29:0/3339658195 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486815d300 con 0x7f48680cab50 2024-04-09T12:05:24.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.617+0000 7f486ffff640 1 librados: init done 2024-04-09T12:05:24.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.618+0000 7f486ffff640 10 client.4271.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:24.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.618+0000 7f486ffff640 15 client.4271.objecter _session_command_op_assign -1 1 2024-04-09T12:05:24.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.618+0000 7f486ffff640 20 client.4271.objecter _get_session osd=-1 returning homeless 2024-04-09T12:05:24.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.618+0000 7f486ffff640 10 client.4271.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.618+0000 7f486ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.618+0000 7f486ffff640 1 -- 172.21.15.29:0/3339658195 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4868034420 con 0x7f48680cab50 2024-04-09T12:05:24.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.618+0000 7f35a62da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35980c3130 0x7f35980332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 1 -- 172.21.15.29:0/1424952199 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40035f0 con 0x7fa7c00b4070 2024-04-09T12:05:24.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 10 monclient: dump: 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.730 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 1 -- 172.21.15.29:0/1424952199 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4003750 con 0x7fa7c00b4070 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 1 -- 172.21.15.29:0/1424952199 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4003b40 con 0x7fa7c00b4070 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7bd7fa640 10 monclient: dump: 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.731 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7c6d47640 5 monclient: authenticate success, global_id 4283 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7beffd640 4 set_mon_vals no callback set 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7c6d47640 10 monclient: _renew_subs 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7c6d47640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7c6d47640 1 -- 172.21.15.29:0/1424952199 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c00b5b20 con 0x7fa7c00b4070 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7c6d47640 10 client.4283.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7c6d47640 10 monclient: _renew_subs 2024-04-09T12:05:24.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7c6d47640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7c6d47640 1 -- 172.21.15.29:0/1424952199 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c00b4b00 con 0x7fa7c00b4070 2024-04-09T12:05:24.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7fa7c6d47640 1 librados: init done 2024-04-09T12:05:24.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7f35a62da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35980c3130 0x7f35980332a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39312/0 (socket says 172.21.15.29:39312) 2024-04-09T12:05:24.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7f35a62da640 1 -- 172.21.15.29:0/1646390046 learned_addr learned my addr 172.21.15.29:0/1646390046 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7f35a62da640 10 monclient(hunting): get_auth_request con 0x7f35980c3130 auth_method 0 2024-04-09T12:05:24.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7f35a62da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7f35a62da640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.626+0000 7f35a62da640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.628+0000 7fa7c6d47640 10 client.4283.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:24.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.628+0000 7fa7c6d47640 15 client.4283.objecter _session_command_op_assign -1 1 2024-04-09T12:05:24.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.628+0000 7fa7c6d47640 20 client.4283.objecter _get_session osd=-1 returning homeless 2024-04-09T12:05:24.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.628+0000 7fa7c6d47640 10 client.4283.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.628+0000 7fa7c6d47640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.628+0000 7fa7c6d47640 1 -- 172.21.15.29:0/1424952199 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7c0145480 con 0x7fa7c00b4070 2024-04-09T12:05:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.628+0000 7f03d8ff9640 1 -- 172.21.15.29:0/131164824 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f03cc007510 con 0x7f03dc0ac880 2024-04-09T12:05:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.628+0000 7f03d8ff9640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f03c806c5e0 0x7f03c806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.628+0000 7f03db7fe640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f03c806c5e0 0x7f03c806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.628+0000 7f03db7fe640 10 monclient: get_auth_request con 0x7f03c806c5e0 auth_method 0 2024-04-09T12:05:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.629+0000 7f03d8ff9640 10 client.4354.objecter ms_handle_connect 0x7f03c806c5e0 2024-04-09T12:05:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.629+0000 7f03db7fe640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f03c806c5e0 0x7f03c806eaa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f03dc06d880 tx=0x7f03d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.629+0000 7f35a62da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.629+0000 7f35a62da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.629+0000 7f35a62da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 1 -- 172.21.15.29:0/131164824 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f03cc057f90 con 0x7f03dc0ac880 2024-04-09T12:05:24.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 10 client.4354.objecter ms_dispatch 0x7f03dc000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:24.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 3 client.4354.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:24.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 3 client.4354.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:24.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 10 client.4354.objecter checking command 1 2024-04-09T12:05:24.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:6802/35530,v1:172.21.15.173:6803/35530] conn(0x7f03c80729c0 0x7f03c8074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 20 client.4354.objecter _get_session s=0x7f03c80722f0 osd=6 3 2024-04-09T12:05:24.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 20 client.4354.objecter put_session s=0x7f03c80722f0 osd=6 3 2024-04-09T12:05:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 15 client.4354.objecter _session_command_op_remove -1 1 2024-04-09T12:05:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 20 client.4354.objecter _get_session s=0x7f03c80722f0 osd=6 3 2024-04-09T12:05:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 20 client.4354.objecter get_session s=0x7f03c80722f0 osd=6 3 2024-04-09T12:05:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 15 client.4354.objecter _session_command_op_assign 6 1 2024-04-09T12:05:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 20 client.4354.objecter put_session s=0x7f03c80722f0 osd=6 4 2024-04-09T12:05:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 10 client.4354.objecter _send_command 1 2024-04-09T12:05:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 1 -- 172.21.15.29:0/131164824 --> [v2:172.21.15.173:6802/35530,v1:172.21.15.173:6803/35530] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03c8075490 con 0x7f03c80729c0 2024-04-09T12:05:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.631+0000 7f03d8ff9640 20 client.4354.objecter dump_active .. 0 homeless 2024-04-09T12:05:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.632+0000 7f03e0823640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:6802/35530,v1:172.21.15.173:6803/35530] conn(0x7f03c80729c0 0x7f03c8074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.632+0000 7f03e0823640 10 monclient: get_auth_request con 0x7f03c80729c0 auth_method 0 2024-04-09T12:05:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.635+0000 7f35a62da640 10 monclient(hunting): handle_auth_done global_id 4286 payload 824 2024-04-09T12:05:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.635+0000 7f35a62da640 1 -- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35980355b0 msgr2=0x7f35980c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.635+0000 7f35a62da640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35980355b0 0x7f35980c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.635+0000 7f35a62da640 1 -- 172.21.15.29:0/1646390046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3598036df0 msgr2=0x7f35980c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.635+0000 7f35a62da640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3598036df0 0x7f35980c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.635+0000 7f35a62da640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.635+0000 7f35a62da640 1 monclient: found mon.noname-c 2024-04-09T12:05:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.635+0000 7f35a62da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.635+0000 7f35a62da640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.635+0000 7f35a62da640 1 -- 172.21.15.29:0/1646390046 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c009400 con 0x7f35980c3130 2024-04-09T12:05:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.636+0000 7f03e0823640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:6802/35530,v1:172.21.15.173:6803/35530] conn(0x7f03c80729c0 0x7f03c8074de0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.636+0000 7f03d8ff9640 10 client.4354.objecter ms_handle_connect 0x7f03c80729c0 2024-04-09T12:05:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.640+0000 7f8c0effd640 1 -- 172.21.15.29:0/774075054 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8c10004020 con 0x7f8c1806bd40 2024-04-09T12:05:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.641+0000 7f8c0effd640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f8bfc06c5e0 0x7f8bfc06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.641+0000 7f8c1dd45640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f8bfc06c5e0 0x7f8bfc06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.641+0000 7f8c1dd45640 10 monclient: get_auth_request con 0x7f8bfc06c5e0 auth_method 0 2024-04-09T12:05:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.641+0000 7f8c1dd45640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f8bfc06c5e0 0x7f8bfc06eaa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c0803b040 tx=0x7f8c08034000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.641+0000 7f8c0effd640 10 client.4287.objecter ms_handle_connect 0x7f8bfc06c5e0 2024-04-09T12:05:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.644+0000 7f8c0effd640 1 -- 172.21.15.29:0/774075054 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8c10058b30 con 0x7f8c1806bd40 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.644+0000 7f8c0effd640 10 client.4287.objecter ms_dispatch 0x7f8c18000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.644+0000 7f8c0effd640 3 client.4287.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.644+0000 7f8c0effd640 3 client.4287.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 10 client.4287.objecter checking command 1 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:6823/35531,v1:172.21.15.173:6826/35531] conn(0x7f8bfc0729c0 0x7f8bfc074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 20 client.4287.objecter _get_session s=0x7f8bfc0722f0 osd=5 3 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 20 client.4287.objecter put_session s=0x7f8bfc0722f0 osd=5 3 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 15 client.4287.objecter _session_command_op_remove -1 1 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 20 client.4287.objecter _get_session s=0x7f8bfc0722f0 osd=5 3 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 20 client.4287.objecter get_session s=0x7f8bfc0722f0 osd=5 3 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 15 client.4287.objecter _session_command_op_assign 5 1 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 20 client.4287.objecter put_session s=0x7f8bfc0722f0 osd=5 4 2024-04-09T12:05:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 10 client.4287.objecter _send_command 1 2024-04-09T12:05:24.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 1 -- 172.21.15.29:0/774075054 --> [v2:172.21.15.173:6823/35531,v1:172.21.15.173:6826/35531] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bfc075490 con 0x7f8bfc0729c0 2024-04-09T12:05:24.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 20 client.4287.objecter dump_active .. 0 homeless 2024-04-09T12:05:24.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 1 -- 172.21.15.29:0/774075054 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c100078b0 con 0x7f8c1806bd40 2024-04-09T12:05:24.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c0effd640 10 monclient: handle_get_version_reply finishing 1 version 25 2024-04-09T12:05:24.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.645+0000 7f8c1ed47640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:6823/35531,v1:172.21.15.173:6826/35531] conn(0x7f8bfc0729c0 0x7f8bfc074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.646+0000 7f8c1ed47640 10 monclient: get_auth_request con 0x7f8bfc0729c0 auth_method 0 2024-04-09T12:05:24.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.647+0000 7f7d7ac4b640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d74141640 0x7f7d741db540 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00c7d0 tx=0x7f7d6c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.647+0000 7f7d6affd640 10 client.?.objecter ms_handle_connect 0x7f7d74141640 2024-04-09T12:05:24.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.647+0000 7f7d6affd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:24.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.649+0000 7f8c0effd640 10 client.4287.objecter ms_handle_connect 0x7f8bfc0729c0 2024-04-09T12:05:24.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.649+0000 7f8c1ed47640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:6823/35531,v1:172.21.15.173:6826/35531] conn(0x7f8bfc0729c0 0x7f8bfc074de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.653+0000 7f7d6affd640 1 -- 172.21.15.29:0/864306481 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c003b70 con 0x7f7d74141640 2024-04-09T12:05:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.653+0000 7f7d6affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.653+0000 7f7d6affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.653+0000 7f7d6affd640 10 monclient: dump: 2024-04-09T12:05:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.653+0000 7f7d6affd640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.653+0000 7f7d6affd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d6affd640 1 -- 172.21.15.29:0/864306481 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c003cf0 con 0x7f7d74141640 2024-04-09T12:05:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d6affd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d6affd640 1 -- 172.21.15.29:0/864306481 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00aa90 con 0x7f7d74141640 2024-04-09T12:05:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d6affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d6affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d6affd640 10 monclient: dump: 2024-04-09T12:05:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 5 monclient: authenticate success, global_id 4293 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 10 monclient: _renew_subs 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/864306481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d740a9680 con 0x7f7d74141640 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d78c47640 4 set_mon_vals no callback set 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 10 client.4293.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 10 monclient: _renew_subs 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/864306481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7406e4a0 con 0x7f7d74141640 2024-04-09T12:05:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 1 librados: init done 2024-04-09T12:05:24.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 10 client.4293.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:24.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 15 client.4293.objecter _session_command_op_assign -1 1 2024-04-09T12:05:24.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 20 client.4293.objecter _get_session osd=-1 returning homeless 2024-04-09T12:05:24.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 10 client.4293.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:24.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.654+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/864306481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d740a9500 con 0x7f7d74141640 2024-04-09T12:05:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.657+0000 7f6f81ffb640 1 -- 172.21.15.29:0/1614127035 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6f88013470 con 0x7f6f8c065d80 2024-04-09T12:05:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.657+0000 7f6f81ffb640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f6f7006c5e0 0x7f6f7006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.658+0000 7f6f90e77640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f6f7006c5e0 0x7f6f7006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.658+0000 7f6f90e77640 10 monclient: get_auth_request con 0x7f6f7006c5e0 auth_method 0 2024-04-09T12:05:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.658+0000 7f6f81ffb640 10 client.4351.objecter ms_handle_connect 0x7f6f7006c5e0 2024-04-09T12:05:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.658+0000 7f6f90e77640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f6f7006c5e0 0x7f6f7006eaa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6f84035000 tx=0x7f6f8402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 1 -- 172.21.15.29:0/1614127035 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6f88058ea0 con 0x7f6f8c065d80 2024-04-09T12:05:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 10 client.4351.objecter ms_dispatch 0x7f6f8c000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 3 client.4351.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 3 client.4351.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 10 client.4351.objecter checking command 1 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.29:6816/35239,v1:172.21.15.29:6817/35239] conn(0x7f6f700729c0 0x7f6f70074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 20 client.4351.objecter _get_session s=0x7f6f700722f0 osd=3 3 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 20 client.4351.objecter put_session s=0x7f6f700722f0 osd=3 3 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 15 client.4351.objecter _session_command_op_remove -1 1 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 20 client.4351.objecter _get_session s=0x7f6f700722f0 osd=3 3 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 20 client.4351.objecter get_session s=0x7f6f700722f0 osd=3 3 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 15 client.4351.objecter _session_command_op_assign 3 1 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 20 client.4351.objecter put_session s=0x7f6f700722f0 osd=3 4 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 10 client.4351.objecter _send_command 1 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 1 -- 172.21.15.29:0/1614127035 --> [v2:172.21.15.29:6816/35239,v1:172.21.15.29:6817/35239] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f70075490 con 0x7f6f700729c0 2024-04-09T12:05:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.660+0000 7f6f81ffb640 20 client.4351.objecter dump_active .. 0 homeless 2024-04-09T12:05:24.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.661+0000 7f6f91e79640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.29:6816/35239,v1:172.21.15.29:6817/35239] conn(0x7f6f700729c0 0x7f6f70074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.661+0000 7f6f91e79640 10 monclient: get_auth_request con 0x7f6f700729c0 auth_method 0 2024-04-09T12:05:24.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.664+0000 7f6f91e79640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.29:6816/35239,v1:172.21.15.29:6817/35239] conn(0x7f6f700729c0 0x7f6f70074de0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.665+0000 7f6f81ffb640 10 client.4351.objecter ms_handle_connect 0x7f6f700729c0 2024-04-09T12:05:24.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.665+0000 7f48577fe640 1 -- 172.21.15.29:0/3339658195 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4870093900 con 0x7f48680cab50 2024-04-09T12:05:24.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.666+0000 7f48577fe640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f485c06c5e0 0x7f485c06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.666+0000 7f486effd640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f485c06c5e0 0x7f485c06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.666+0000 7f486effd640 10 monclient: get_auth_request con 0x7f485c06c5e0 auth_method 0 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.666+0000 7f486effd640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f485c06c5e0 0x7f485c06eaa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4860004ea0 tx=0x7f4860009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.667+0000 7f48577fe640 10 client.4271.objecter ms_handle_connect 0x7f485c06c5e0 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 1 -- 172.21.15.29:0/3339658195 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f48700d22c0 con 0x7f48680cab50 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 10 client.4271.objecter ms_dispatch 0x7f4870000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 3 client.4271.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 3 client.4271.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 10 client.4271.objecter checking command 1 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] conn(0x7f485c0729c0 0x7f485c074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 20 client.4271.objecter _get_session s=0x7f485c0722f0 osd=2 3 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 20 client.4271.objecter put_session s=0x7f485c0722f0 osd=2 3 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 15 client.4271.objecter _session_command_op_remove -1 1 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 20 client.4271.objecter _get_session s=0x7f485c0722f0 osd=2 3 2024-04-09T12:05:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 20 client.4271.objecter get_session s=0x7f485c0722f0 osd=2 3 2024-04-09T12:05:24.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 15 client.4271.objecter _session_command_op_assign 2 1 2024-04-09T12:05:24.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 20 client.4271.objecter put_session s=0x7f485c0722f0 osd=2 4 2024-04-09T12:05:24.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 10 client.4271.objecter _send_command 1 2024-04-09T12:05:24.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 1 -- 172.21.15.29:0/3339658195 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f485c075490 con 0x7f485c0729c0 2024-04-09T12:05:24.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f48577fe640 20 client.4271.objecter dump_active .. 0 homeless 2024-04-09T12:05:24.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f486e7fc640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] conn(0x7f485c0729c0 0x7f485c074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.676+0000 7f486e7fc640 10 monclient: get_auth_request con 0x7f485c0729c0 auth_method 0 2024-04-09T12:05:24.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.678+0000 7f7d6affd640 1 -- 172.21.15.29:0/864306481 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7d6c00abf0 con 0x7f7d74141640 2024-04-09T12:05:24.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.678+0000 7f7d6affd640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f7d5806c5e0 0x7f7d5806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.679+0000 7f7d7a44a640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f7d5806c5e0 0x7f7d5806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.679+0000 7f7d7a44a640 10 monclient: get_auth_request con 0x7f7d5806c5e0 auth_method 0 2024-04-09T12:05:24.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.679+0000 7f7d7a44a640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f7d5806c5e0 0x7f7d5806eaa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009710 tx=0x7f7d70006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.679+0000 7f7d6affd640 10 client.4293.objecter ms_handle_connect 0x7f7d5806c5e0 2024-04-09T12:05:24.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.680+0000 7f486e7fc640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] conn(0x7f485c0729c0 0x7f485c074de0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.680+0000 7f48577fe640 10 client.4271.objecter ms_handle_connect 0x7f485c0729c0 2024-04-09T12:05:24.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 1 -- 172.21.15.29:0/864306481 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7d6c0591b0 con 0x7f7d74141640 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 10 client.4293.objecter ms_dispatch 0x7f7d74000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 3 client.4293.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 3 client.4293.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 10 client.4293.objecter checking command 1 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.29:6808/35238,v1:172.21.15.29:6809/35238] conn(0x7f7d580729c0 0x7f7d58074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 20 client.4293.objecter _get_session s=0x7f7d580722f0 osd=0 3 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 20 client.4293.objecter put_session s=0x7f7d580722f0 osd=0 3 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 15 client.4293.objecter _session_command_op_remove -1 1 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 20 client.4293.objecter _get_session s=0x7f7d580722f0 osd=0 3 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 20 client.4293.objecter get_session s=0x7f7d580722f0 osd=0 3 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 15 client.4293.objecter _session_command_op_assign 0 1 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 20 client.4293.objecter put_session s=0x7f7d580722f0 osd=0 4 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 10 client.4293.objecter _send_command 1 2024-04-09T12:05:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 1 -- 172.21.15.29:0/864306481 --> [v2:172.21.15.29:6808/35238,v1:172.21.15.29:6809/35238] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d58075490 con 0x7f7d580729c0 2024-04-09T12:05:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 20 client.4293.objecter dump_active .. 0 homeless 2024-04-09T12:05:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 1 -- 172.21.15.29:0/864306481 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d6c00aea0 con 0x7f7d74141640 2024-04-09T12:05:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.681+0000 7f7d6affd640 10 monclient: handle_get_version_reply finishing 1 version 25 2024-04-09T12:05:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.682+0000 7f7d79c49640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.29:6808/35238,v1:172.21.15.29:6809/35238] conn(0x7f7d580729c0 0x7f7d58074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.682+0000 7f7d79c49640 10 monclient: get_auth_request con 0x7f7d580729c0 auth_method 0 2024-04-09T12:05:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.685+0000 7f7d6affd640 10 client.4293.objecter ms_handle_connect 0x7f7d580729c0 2024-04-09T12:05:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.685+0000 7f7d79c49640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.29:6808/35238,v1:172.21.15.29:6809/35238] conn(0x7f7d580729c0 0x7f7d58074de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.686+0000 7f03d8ff9640 1 -- 172.21.15.29:0/131164824 <== osd.6 v2:172.21.15.173:6802/35530 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f03c8075490 con 0x7f03c80729c0 2024-04-09T12:05:24.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.686+0000 7f03d8ff9640 10 client.4354.objecter ms_dispatch 0x7f03dc000b90 command_reply(tid 1: 0 ) v1 2024-04-09T12:05:24.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.686+0000 7f03d8ff9640 10 client.4354.objecter _finish_command 1 = system:0 2024-04-09T12:05:24.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.686+0000 7f03d8ff9640 20 client.4354.objecter put_session s=0x7f03c80722f0 osd=6 4 2024-04-09T12:05:24.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.686+0000 7f03d8ff9640 15 client.4354.objecter _session_command_op_remove 6 1 2024-04-09T12:05:24.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.693+0000 7f8c0effd640 1 -- 172.21.15.29:0/774075054 <== osd.5 v2:172.21.15.173:6823/35531 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f8bfc075490 con 0x7f8bfc0729c0 2024-04-09T12:05:24.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.693+0000 7f8c0effd640 10 client.4287.objecter ms_dispatch 0x7f8c18000b90 command_reply(tid 1: 0 ) v1 2024-04-09T12:05:24.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.693+0000 7f8c0effd640 10 client.4287.objecter _finish_command 1 = system:0 2024-04-09T12:05:24.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.693+0000 7f8c0effd640 20 client.4287.objecter put_session s=0x7f8bfc0722f0 osd=5 4 2024-04-09T12:05:24.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.693+0000 7f8c0effd640 15 client.4287.objecter _session_command_op_remove 5 1 2024-04-09T12:05:24.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.701+0000 7fa7bd7fa640 1 -- 172.21.15.29:0/1424952199 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa7b4003ca0 con 0x7fa7c00b4070 2024-04-09T12:05:24.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.701+0000 7fa7bd7fa640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fa7a406c610 0x7fa7a406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.701+0000 7fa7bffff640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fa7a406c610 0x7fa7a406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.701+0000 7fa7bffff640 10 monclient: get_auth_request con 0x7fa7a406c610 auth_method 0 2024-04-09T12:05:24.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.702+0000 7fa7bffff640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fa7a406c610 0x7fa7a406ead0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac036000 tx=0x7fa7ac03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.702+0000 7fa7bd7fa640 10 client.4283.objecter ms_handle_connect 0x7fa7a406c610 2024-04-09T12:05:24.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.704+0000 7fa7bd7fa640 1 -- 172.21.15.29:0/1424952199 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa7b40010c0 con 0x7fa7c00b4070 2024-04-09T12:05:24.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.704+0000 7fa7bd7fa640 10 client.4283.objecter ms_dispatch 0x7fa7c0000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:24.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.704+0000 7fa7bd7fa640 3 client.4283.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:24.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.704+0000 7fa7bd7fa640 3 client.4283.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:24.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 10 client.4283.objecter checking command 1 2024-04-09T12:05:24.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.29:6824/35236,v1:172.21.15.29:6825/35236] conn(0x7fa7a40729f0 0x7fa7a4074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 20 client.4283.objecter _get_session s=0x7fa7a4072320 osd=1 3 2024-04-09T12:05:24.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 20 client.4283.objecter put_session s=0x7fa7a4072320 osd=1 3 2024-04-09T12:05:24.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 15 client.4283.objecter _session_command_op_remove -1 1 2024-04-09T12:05:24.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 20 client.4283.objecter _get_session s=0x7fa7a4072320 osd=1 3 2024-04-09T12:05:24.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 20 client.4283.objecter get_session s=0x7fa7a4072320 osd=1 3 2024-04-09T12:05:24.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 15 client.4283.objecter _session_command_op_assign 1 1 2024-04-09T12:05:24.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 20 client.4283.objecter put_session s=0x7fa7a4072320 osd=1 4 2024-04-09T12:05:24.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 10 client.4283.objecter _send_command 1 2024-04-09T12:05:24.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 1 -- 172.21.15.29:0/1424952199 --> [v2:172.21.15.29:6824/35236,v1:172.21.15.29:6825/35236] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7a40754c0 con 0x7fa7a40729f0 2024-04-09T12:05:24.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7bd7fa640 20 client.4283.objecter dump_active .. 0 homeless 2024-04-09T12:05:24.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.705+0000 7fa7c52e4640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.29:6824/35236,v1:172.21.15.29:6825/35236] conn(0x7fa7a40729f0 0x7fa7a4074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.706+0000 7fa7c52e4640 10 monclient: get_auth_request con 0x7fa7a40729f0 auth_method 0 2024-04-09T12:05:24.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.706+0000 7f35a62da640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35980c3130 0x7f35980332a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f35a004f940 tx=0x7f35a0067180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.706+0000 7f35967fc640 10 client.?.objecter ms_handle_connect 0x7f35980c3130 2024-04-09T12:05:24.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.706+0000 7f35967fc640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:24.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.712+0000 7fa7c52e4640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.29:6824/35236,v1:172.21.15.29:6825/35236] conn(0x7fa7a40729f0 0x7fa7a4074e10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.712+0000 7fa7bd7fa640 10 client.4283.objecter ms_handle_connect 0x7fa7a40729f0 2024-04-09T12:05:24.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.720+0000 7f03e1024640 10 client.4354.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-09T12:05:24.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.720+0000 7f03e1024640 15 client.4354.objecter _session_command_op_assign -1 2 2024-04-09T12:05:24.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.720+0000 7f03e1024640 20 client.4354.objecter _get_session s=0x7f03c80722f0 osd=6 3 2024-04-09T12:05:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.720+0000 7f03e1024640 20 client.4354.objecter put_session s=0x7f03c80722f0 osd=6 3 2024-04-09T12:05:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.720+0000 7f03e1024640 20 client.4354.objecter _get_session s=0x7f03c80722f0 osd=6 3 2024-04-09T12:05:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.720+0000 7f03e1024640 15 client.4354.objecter _session_command_op_remove -1 2 2024-04-09T12:05:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.720+0000 7f03e1024640 20 client.4354.objecter get_session s=0x7f03c80722f0 osd=6 3 2024-04-09T12:05:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.720+0000 7f03e1024640 15 client.4354.objecter _session_command_op_assign 6 2 2024-04-09T12:05:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.720+0000 7f03e1024640 20 client.4354.objecter put_session s=0x7f03c80722f0 osd=6 4 2024-04-09T12:05:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.720+0000 7f03e1024640 10 client.4354.objecter _send_command 2 2024-04-09T12:05:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.720+0000 7f03e1024640 1 -- 172.21.15.29:0/131164824 --> [v2:172.21.15.173:6802/35530,v1:172.21.15.173:6803/35530] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f03dc14bde0 con 0x7f03c80729c0 2024-04-09T12:05:24.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.724+0000 7f8c1f548640 10 client.4287.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-09T12:05:24.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.724+0000 7f8c1f548640 15 client.4287.objecter _session_command_op_assign -1 2 2024-04-09T12:05:24.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.724+0000 7f8c1f548640 20 client.4287.objecter _get_session s=0x7f8bfc0722f0 osd=5 3 2024-04-09T12:05:24.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.724+0000 7f8c1f548640 20 client.4287.objecter put_session s=0x7f8bfc0722f0 osd=5 3 2024-04-09T12:05:24.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.724+0000 7f8c1f548640 20 client.4287.objecter _get_session s=0x7f8bfc0722f0 osd=5 3 2024-04-09T12:05:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.724+0000 7f8c1f548640 15 client.4287.objecter _session_command_op_remove -1 2 2024-04-09T12:05:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.724+0000 7f8c1f548640 20 client.4287.objecter get_session s=0x7f8bfc0722f0 osd=5 3 2024-04-09T12:05:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.724+0000 7f8c1f548640 15 client.4287.objecter _session_command_op_assign 5 2 2024-04-09T12:05:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.724+0000 7f8c1f548640 20 client.4287.objecter put_session s=0x7f8bfc0722f0 osd=5 4 2024-04-09T12:05:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.724+0000 7f8c1f548640 10 client.4287.objecter _send_command 2 2024-04-09T12:05:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.724+0000 7f8c1f548640 1 -- 172.21.15.29:0/774075054 --> [v2:172.21.15.173:6823/35531,v1:172.21.15.173:6826/35531] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c1806ee80 con 0x7f8bfc0729c0 2024-04-09T12:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.726+0000 7f03d8ff9640 1 -- 172.21.15.29:0/131164824 <== osd.6 v2:172.21.15.173:6802/35530 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f03dc14bde0 con 0x7f03c80729c0 2024-04-09T12:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.726+0000 7f03d8ff9640 10 client.4354.objecter ms_dispatch 0x7f03dc000b90 command_reply(tid 2: 0 ) v1 2024-04-09T12:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.726+0000 7f03d8ff9640 10 client.4354.objecter _finish_command 2 = system:0 2024-04-09T12:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.726+0000 7f03d8ff9640 20 client.4354.objecter put_session s=0x7f03c80722f0 osd=6 4 2024-04-09T12:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.726+0000 7f03d8ff9640 15 client.4354.objecter _session_command_op_remove 6 2 2024-04-09T12:05:24.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.726+0000 7f03e1024640 10 librados: watch_flush enter 2024-04-09T12:05:24.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.726+0000 7f03e1024640 10 librados: watch_flush exit 2024-04-09T12:05:24.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 10 client.4354.objecter close_session for osd.6 2024-04-09T12:05:24.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 1 -- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:6802/35530,v1:172.21.15.173:6803/35530] conn(0x7f03c80729c0 msgr2=0x7f03c8074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:6802/35530,v1:172.21.15.173:6803/35530] conn(0x7f03c80729c0 0x7f03c8074de0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 20 client.4354.objecter put_session s=0x7f03c80722f0 osd=6 1 2024-04-09T12:05:24.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 20 client.4354.objecter shutdown clearing up homeless session... 2024-04-09T12:05:24.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 10 client.4354.objecter successfully canceled tick 2024-04-09T12:05:24.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 1 -- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f03c806c5e0 msgr2=0x7f03c806eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f03c806c5e0 0x7f03c806eaa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f03dc06d880 tx=0x7f03d0008040 comp rx=0 tx=0).stop 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 10 monclient: shutdown 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 20 monclient: shutdown canceling and discarding version request 1 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 1 -- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc0ac880 msgr2=0x7f03dc13c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 1 --2- 172.21.15.29:0/131164824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc0ac880 0x7f03dc13c4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f03cc00c480 tx=0x7f03cc00c940 comp rx=0 tx=0).stop 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e0823640 1 -- 172.21.15.29:0/131164824 reap_dead start 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 1 -- 172.21.15.29:0/131164824 shutdown_connections 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 1 -- 172.21.15.29:0/131164824 >> 172.21.15.29:0/131164824 conn(0x7f03dc0b2c80 msgr2=0x7f03dc0b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 1 -- 172.21.15.29:0/131164824 shutdown_connections 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.727+0000 7f03e1024640 1 -- 172.21.15.29:0/131164824 wait complete. 2024-04-09T12:05:24.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.728+0000 7f03e1024640 1 librados: shutdown 2024-04-09T12:05:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.730+0000 7f8c0effd640 1 -- 172.21.15.29:0/774075054 <== osd.5 v2:172.21.15.173:6823/35531 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8c14005090 con 0x7f8bfc0729c0 2024-04-09T12:05:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.730+0000 7f8c0effd640 10 client.4287.objecter ms_dispatch 0x7f8c18000b90 command_reply(tid 2: 0 ) v1 2024-04-09T12:05:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.730+0000 7f8c0effd640 10 client.4287.objecter _finish_command 2 = system:0 2024-04-09T12:05:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.730+0000 7f8c0effd640 20 client.4287.objecter put_session s=0x7f8bfc0722f0 osd=5 4 2024-04-09T12:05:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.730+0000 7f8c0effd640 15 client.4287.objecter _session_command_op_remove 5 2 2024-04-09T12:05:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.731+0000 7f8c1f548640 10 librados: watch_flush enter 2024-04-09T12:05:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.731+0000 7f8c1f548640 10 librados: watch_flush exit 2024-04-09T12:05:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.731+0000 7f8c1f548640 10 client.4287.objecter close_session for osd.5 2024-04-09T12:05:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.731+0000 7f8c1f548640 1 -- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:6823/35531,v1:172.21.15.173:6826/35531] conn(0x7f8bfc0729c0 msgr2=0x7f8bfc074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.731+0000 7f8c1f548640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:6823/35531,v1:172.21.15.173:6826/35531] conn(0x7f8bfc0729c0 0x7f8bfc074de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.731+0000 7f8c1f548640 20 client.4287.objecter put_session s=0x7f8bfc0722f0 osd=5 1 2024-04-09T12:05:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.731+0000 7f8c1f548640 20 client.4287.objecter shutdown clearing up homeless session... 2024-04-09T12:05:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.731+0000 7f8c1f548640 10 client.4287.objecter successfully canceled tick 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.732+0000 7f8c1f548640 1 -- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f8bfc06c5e0 msgr2=0x7f8bfc06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.732+0000 7f8c1f548640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f8bfc06c5e0 0x7f8bfc06eaa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c0803b040 tx=0x7f8c08034000 comp rx=0 tx=0).stop 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.732+0000 7f8c1f548640 10 monclient: shutdown 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.732+0000 7f8c1f548640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.732+0000 7f8c1f548640 1 -- 172.21.15.29:0/774075054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c1806bd40 msgr2=0x7f8c181d26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.732+0000 7f8c1f548640 1 --2- 172.21.15.29:0/774075054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c1806bd40 0x7f8c181d26a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000cc10 tx=0x7f8c1000a5c0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.732+0000 7f8c1ed47640 1 -- 172.21.15.29:0/774075054 reap_dead start 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.733+0000 7f8c1f548640 1 -- 172.21.15.29:0/774075054 shutdown_connections 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.733+0000 7f8c1f548640 1 -- 172.21.15.29:0/774075054 >> 172.21.15.29:0/774075054 conn(0x7f8c180b30a0 msgr2=0x7f8c180afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.733+0000 7f8c1f548640 1 -- 172.21.15.29:0/774075054 shutdown_connections 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.733+0000 7f8c1f548640 1 -- 172.21.15.29:0/774075054 wait complete. 2024-04-09T12:05:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.733+0000 7f8c1f548640 1 librados: shutdown 2024-04-09T12:05:24.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.738+0000 7fdc6d7fa640 1 -- 172.21.15.29:0/3890621766 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdc68007070 con 0x7fdc70144c50 2024-04-09T12:05:24.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.738+0000 7fdc6d7fa640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fdc5406c5e0 0x7fdc5406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.738+0000 7fdc7492d640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fdc5406c5e0 0x7fdc5406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.738+0000 7fdc7492d640 10 monclient: get_auth_request con 0x7fdc5406c5e0 auth_method 0 2024-04-09T12:05:24.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.739+0000 7f6f81ffb640 1 -- 172.21.15.29:0/1614127035 <== osd.3 v2:172.21.15.29:6816/35239 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6f70075490 con 0x7f6f700729c0 2024-04-09T12:05:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.739+0000 7f6f81ffb640 10 client.4351.objecter ms_dispatch 0x7f6f8c000b90 command_reply(tid 1: 0 ) v1 2024-04-09T12:05:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.739+0000 7f6f81ffb640 10 client.4351.objecter _finish_command 1 = system:0 2024-04-09T12:05:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.739+0000 7f6f81ffb640 20 client.4351.objecter put_session s=0x7f6f700722f0 osd=3 4 2024-04-09T12:05:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.739+0000 7f6f81ffb640 15 client.4351.objecter _session_command_op_remove 3 1 2024-04-09T12:05:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.739+0000 7fdc7492d640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fdc5406c5e0 0x7fdc5406eaa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009b40 tx=0x7fdc64009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.739+0000 7fdc6d7fa640 10 client.4277.objecter ms_handle_connect 0x7fdc5406c5e0 2024-04-09T12:05:24.782 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-04-09T12:05:24.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-09T12:05:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 1 -- 172.21.15.29:0/3890621766 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdc680588e0 con 0x7fdc70144c50 2024-04-09T12:05:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 10 client.4277.objecter ms_dispatch 0x7fdc70000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 3 client.4277.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 3 client.4277.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 10 client.4277.objecter checking command 1 2024-04-09T12:05:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:6810/35532,v1:172.21.15.173:6811/35532] conn(0x7fdc54073360 0x7fdc54075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 20 client.4277.objecter _get_session s=0x7fdc54072c90 osd=7 3 2024-04-09T12:05:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 20 client.4277.objecter put_session s=0x7fdc54072c90 osd=7 3 2024-04-09T12:05:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 15 client.4277.objecter _session_command_op_remove -1 1 2024-04-09T12:05:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 20 client.4277.objecter _get_session s=0x7fdc54072c90 osd=7 3 2024-04-09T12:05:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 20 client.4277.objecter get_session s=0x7fdc54072c90 osd=7 3 2024-04-09T12:05:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 15 client.4277.objecter _session_command_op_assign 7 1 2024-04-09T12:05:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 20 client.4277.objecter put_session s=0x7fdc54072c90 osd=7 4 2024-04-09T12:05:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 10 client.4277.objecter _send_command 1 2024-04-09T12:05:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 1 -- 172.21.15.29:0/3890621766 --> [v2:172.21.15.173:6810/35532,v1:172.21.15.173:6811/35532] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc54075ed0 con 0x7fdc54073360 2024-04-09T12:05:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.746+0000 7fdc6d7fa640 20 client.4277.objecter dump_active .. 0 homeless 2024-04-09T12:05:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7fdc6ffff640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:6810/35532,v1:172.21.15.173:6811/35532] conn(0x7fdc54073360 0x7fdc54075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 1 -- 172.21.15.29:0/1646390046 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a00721c0 con 0x7f35980c3130 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 10 monclient: dump: 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 1 -- 172.21.15.29:0/1646390046 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a0072340 con 0x7f35980c3130 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 1 -- 172.21.15.29:0/1646390046 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0060a70 con 0x7f35980c3130 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35967fc640 10 monclient: dump: 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.787 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35a6adb640 5 monclient: authenticate success, global_id 4286 2024-04-09T12:05:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35a6adb640 10 monclient: _renew_subs 2024-04-09T12:05:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35a6adb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35a6adb640 1 -- 172.21.15.29:0/1646390046 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35980095d0 con 0x7f35980c3130 2024-04-09T12:05:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f3597fff640 4 set_mon_vals no callback set 2024-04-09T12:05:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35a6adb640 10 client.4286.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35a6adb640 10 monclient: _renew_subs 2024-04-09T12:05:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35a6adb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.747+0000 7f35a6adb640 1 -- 172.21.15.29:0/1646390046 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3598034b70 con 0x7f35980c3130 2024-04-09T12:05:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.748+0000 7f35a6adb640 1 librados: init done 2024-04-09T12:05:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.748+0000 7fdc6ffff640 10 monclient: get_auth_request con 0x7fdc54073360 auth_method 0 2024-04-09T12:05:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.749+0000 7f3583fff640 10 client.4286.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.749+0000 7f3583fff640 15 client.4286.objecter _session_command_op_assign -1 1 2024-04-09T12:05:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.749+0000 7f3583fff640 20 client.4286.objecter _get_session osd=-1 returning homeless 2024-04-09T12:05:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.749+0000 7f3583fff640 10 client.4286.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.749+0000 7f3583fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.749+0000 7f3583fff640 1 -- 172.21.15.29:0/1646390046 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f357c0028a0 con 0x7f35980c3130 2024-04-09T12:05:24.790 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-04-09T12:05:24.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-09T12:05:24.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.751+0000 7f48577fe640 1 -- 172.21.15.29:0/3339658195 <== osd.2 v2:172.21.15.29:6800/35237 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f485c075490 con 0x7f485c0729c0 2024-04-09T12:05:24.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.751+0000 7f48577fe640 10 client.4271.objecter ms_dispatch 0x7f4870000b90 command_reply(tid 1: 0 ) v1 2024-04-09T12:05:24.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.751+0000 7f48577fe640 10 client.4271.objecter _finish_command 1 = system:0 2024-04-09T12:05:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.751+0000 7f48577fe640 20 client.4271.objecter put_session s=0x7f485c0722f0 osd=2 4 2024-04-09T12:05:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.751+0000 7f48577fe640 15 client.4271.objecter _session_command_op_remove 2 1 2024-04-09T12:05:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.754+0000 7fdc6d7fa640 10 client.4277.objecter ms_handle_connect 0x7fdc54073360 2024-04-09T12:05:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.754+0000 7fdc6ffff640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:6810/35532,v1:172.21.15.173:6811/35532] conn(0x7fdc54073360 0x7fdc54075800 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.757+0000 7f7d6affd640 1 -- 172.21.15.29:0/864306481 <== osd.0 v2:172.21.15.29:6808/35238 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f7d58075490 con 0x7f7d580729c0 2024-04-09T12:05:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.757+0000 7f7d6affd640 10 client.4293.objecter ms_dispatch 0x7f7d74000b90 command_reply(tid 1: 0 ) v1 2024-04-09T12:05:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.757+0000 7f7d6affd640 10 client.4293.objecter _finish_command 1 = system:0 2024-04-09T12:05:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.757+0000 7f7d6affd640 20 client.4293.objecter put_session s=0x7f7d580722f0 osd=0 4 2024-04-09T12:05:24.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.757+0000 7f7d6affd640 15 client.4293.objecter _session_command_op_remove 0 1 2024-04-09T12:05:24.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.768+0000 7f6f938dc640 10 client.4351.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-09T12:05:24.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f6f938dc640 15 client.4351.objecter _session_command_op_assign -1 2 2024-04-09T12:05:24.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f6f938dc640 20 client.4351.objecter _get_session s=0x7f6f700722f0 osd=3 3 2024-04-09T12:05:24.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f6f938dc640 20 client.4351.objecter put_session s=0x7f6f700722f0 osd=3 3 2024-04-09T12:05:24.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f6f938dc640 20 client.4351.objecter _get_session s=0x7f6f700722f0 osd=3 3 2024-04-09T12:05:24.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f6f938dc640 15 client.4351.objecter _session_command_op_remove -1 2 2024-04-09T12:05:24.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f6f938dc640 20 client.4351.objecter get_session s=0x7f6f700722f0 osd=3 3 2024-04-09T12:05:24.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f6f938dc640 15 client.4351.objecter _session_command_op_assign 3 2 2024-04-09T12:05:24.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f6f938dc640 20 client.4351.objecter put_session s=0x7f6f700722f0 osd=3 4 2024-04-09T12:05:24.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f6f938dc640 10 client.4351.objecter _send_command 2 2024-04-09T12:05:24.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f6f938dc640 1 -- 172.21.15.29:0/1614127035 --> [v2:172.21.15.29:6816/35239,v1:172.21.15.29:6817/35239] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f8c0b4670 con 0x7f6f700729c0 2024-04-09T12:05:24.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f486ffff640 10 client.4271.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-09T12:05:24.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f486ffff640 15 client.4271.objecter _session_command_op_assign -1 2 2024-04-09T12:05:24.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f486ffff640 20 client.4271.objecter _get_session s=0x7f485c0722f0 osd=2 3 2024-04-09T12:05:24.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f486ffff640 20 client.4271.objecter put_session s=0x7f485c0722f0 osd=2 3 2024-04-09T12:05:24.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f486ffff640 20 client.4271.objecter _get_session s=0x7f485c0722f0 osd=2 3 2024-04-09T12:05:24.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f486ffff640 15 client.4271.objecter _session_command_op_remove -1 2 2024-04-09T12:05:24.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f486ffff640 20 client.4271.objecter get_session s=0x7f485c0722f0 osd=2 3 2024-04-09T12:05:24.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f486ffff640 15 client.4271.objecter _session_command_op_assign 2 2 2024-04-09T12:05:24.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f486ffff640 20 client.4271.objecter put_session s=0x7f485c0722f0 osd=2 4 2024-04-09T12:05:24.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f486ffff640 10 client.4271.objecter _send_command 2 2024-04-09T12:05:24.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.769+0000 7f486ffff640 1 -- 172.21.15.29:0/3339658195 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4868034420 con 0x7f485c0729c0 2024-04-09T12:05:24.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.772+0000 7f7d7c6ae640 10 client.4293.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-09T12:05:24.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.772+0000 7f7d7c6ae640 15 client.4293.objecter _session_command_op_assign -1 2 2024-04-09T12:05:24.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.772+0000 7f7d7c6ae640 20 client.4293.objecter _get_session s=0x7f7d580722f0 osd=0 3 2024-04-09T12:05:24.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.772+0000 7f7d7c6ae640 20 client.4293.objecter put_session s=0x7f7d580722f0 osd=0 3 2024-04-09T12:05:24.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.772+0000 7f7d7c6ae640 20 client.4293.objecter _get_session s=0x7f7d580722f0 osd=0 3 2024-04-09T12:05:24.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.772+0000 7f7d7c6ae640 15 client.4293.objecter _session_command_op_remove -1 2 2024-04-09T12:05:24.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.772+0000 7f7d7c6ae640 20 client.4293.objecter get_session s=0x7f7d580722f0 osd=0 3 2024-04-09T12:05:24.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.772+0000 7f7d7c6ae640 15 client.4293.objecter _session_command_op_assign 0 2 2024-04-09T12:05:24.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.772+0000 7f7d7c6ae640 20 client.4293.objecter put_session s=0x7f7d580722f0 osd=0 4 2024-04-09T12:05:24.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.772+0000 7f7d7c6ae640 10 client.4293.objecter _send_command 2 2024-04-09T12:05:24.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.772+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/864306481 --> [v2:172.21.15.29:6808/35238,v1:172.21.15.29:6809/35238] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7d740b26f0 con 0x7f7d580729c0 2024-04-09T12:05:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.780+0000 7f7d6affd640 1 -- 172.21.15.29:0/864306481 <== osd.0 v2:172.21.15.29:6808/35238 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7d58075490 con 0x7f7d580729c0 2024-04-09T12:05:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.780+0000 7f7d6affd640 10 client.4293.objecter ms_dispatch 0x7f7d74000b90 command_reply(tid 2: 0 ) v1 2024-04-09T12:05:24.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.780+0000 7f7d6affd640 10 client.4293.objecter _finish_command 2 = system:0 2024-04-09T12:05:24.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.780+0000 7f7d6affd640 20 client.4293.objecter put_session s=0x7f7d580722f0 osd=0 4 2024-04-09T12:05:24.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.780+0000 7f7d6affd640 15 client.4293.objecter _session_command_op_remove 0 2 2024-04-09T12:05:24.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 10 librados: watch_flush enter 2024-04-09T12:05:24.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 10 librados: watch_flush exit 2024-04-09T12:05:24.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 10 client.4293.objecter close_session for osd.0 2024-04-09T12:05:24.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/864306481 >> [v2:172.21.15.29:6808/35238,v1:172.21.15.29:6809/35238] conn(0x7f7d580729c0 msgr2=0x7f7d58074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.29:6808/35238,v1:172.21.15.29:6809/35238] conn(0x7f7d580729c0 0x7f7d58074de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 20 client.4293.objecter put_session s=0x7f7d580722f0 osd=0 1 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 20 client.4293.objecter shutdown clearing up homeless session... 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 10 client.4293.objecter successfully canceled tick 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/864306481 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f7d5806c5e0 msgr2=0x7f7d5806eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f7d5806c5e0 0x7f7d5806eaa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009710 tx=0x7f7d70006c90 comp rx=0 tx=0).stop 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 10 monclient: shutdown 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/864306481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d74141640 msgr2=0x7f7d741db540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 1 --2- 172.21.15.29:0/864306481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d74141640 0x7f7d741db540 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00c7d0 tx=0x7f7d6c00cc90 comp rx=0 tx=0).stop 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7ac4b640 1 -- 172.21.15.29:0/864306481 reap_dead start 2024-04-09T12:05:24.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/864306481 shutdown_connections 2024-04-09T12:05:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/864306481 >> 172.21.15.29:0/864306481 conn(0x7f7d74065f30 msgr2=0x7f7d7413ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.781+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/864306481 shutdown_connections 2024-04-09T12:05:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.782+0000 7f7d7c6ae640 1 -- 172.21.15.29:0/864306481 wait complete. 2024-04-09T12:05:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.782+0000 7f7d7c6ae640 1 librados: shutdown 2024-04-09T12:05:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f48577fe640 1 -- 172.21.15.29:0/3339658195 <== osd.2 v2:172.21.15.29:6800/35237 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4864031db0 con 0x7f485c0729c0 2024-04-09T12:05:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f48577fe640 10 client.4271.objecter ms_dispatch 0x7f4870000b90 command_reply(tid 2: 0 ) v1 2024-04-09T12:05:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f48577fe640 10 client.4271.objecter _finish_command 2 = system:0 2024-04-09T12:05:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f48577fe640 20 client.4271.objecter put_session s=0x7f485c0722f0 osd=2 4 2024-04-09T12:05:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f48577fe640 15 client.4271.objecter _session_command_op_remove 2 2 2024-04-09T12:05:24.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 10 librados: watch_flush enter 2024-04-09T12:05:24.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 10 librados: watch_flush exit 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 10 client.4271.objecter close_session for osd.2 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 1 -- 172.21.15.29:0/3339658195 >> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] conn(0x7f485c0729c0 msgr2=0x7f485c074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] conn(0x7f485c0729c0 0x7f485c074de0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 20 client.4271.objecter put_session s=0x7f485c0722f0 osd=2 1 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 20 client.4271.objecter shutdown clearing up homeless session... 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 10 client.4271.objecter successfully canceled tick 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 1 -- 172.21.15.29:0/3339658195 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f485c06c5e0 msgr2=0x7f485c06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f485c06c5e0 0x7f485c06eaa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4860004ea0 tx=0x7f4860009040 comp rx=0 tx=0).stop 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 10 monclient: shutdown 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 20 monclient: shutdown canceling and discarding version request 1 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 1 -- 172.21.15.29:0/3339658195 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48680cab50 msgr2=0x7f486815cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 1 --2- 172.21.15.29:0/3339658195 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48680cab50 0x7f486815cdc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4870069870 tx=0x7f4870067180 comp rx=0 tx=0).stop 2024-04-09T12:05:24.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486f7fe640 1 -- 172.21.15.29:0/3339658195 reap_dead start 2024-04-09T12:05:24.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 1 -- 172.21.15.29:0/3339658195 shutdown_connections 2024-04-09T12:05:24.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 1 -- 172.21.15.29:0/3339658195 >> 172.21.15.29:0/3339658195 conn(0x7f48680065d0 msgr2=0x7f48680c8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 1 -- 172.21.15.29:0/3339658195 shutdown_connections 2024-04-09T12:05:24.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.785+0000 7f486ffff640 1 -- 172.21.15.29:0/3339658195 wait complete. 2024-04-09T12:05:24.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.786+0000 7f486ffff640 1 librados: shutdown 2024-04-09T12:05:24.805 INFO:teuthology.orchestra.run.smithi029.stdout:60129542150 2024-04-09T12:05:24.805 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-09T12:05:24.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.799+0000 7fdc6d7fa640 1 -- 172.21.15.29:0/3890621766 <== osd.7 v2:172.21.15.173:6810/35532 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fdc54075ed0 con 0x7fdc54073360 2024-04-09T12:05:24.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.800+0000 7fdc6d7fa640 10 client.4277.objecter ms_dispatch 0x7fdc70000b90 command_reply(tid 1: 0 ) v1 2024-04-09T12:05:24.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.800+0000 7fdc6d7fa640 10 client.4277.objecter _finish_command 1 = system:0 2024-04-09T12:05:24.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.800+0000 7fdc6d7fa640 20 client.4277.objecter put_session s=0x7fdc54072c90 osd=7 4 2024-04-09T12:05:24.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.800+0000 7fdc6d7fa640 15 client.4277.objecter _session_command_op_remove 7 1 2024-04-09T12:05:24.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.801+0000 7fa7bd7fa640 1 -- 172.21.15.29:0/1424952199 <== osd.1 v2:172.21.15.29:6824/35236 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fa7a40754c0 con 0x7fa7a40729f0 2024-04-09T12:05:24.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.801+0000 7fa7bd7fa640 10 client.4283.objecter ms_dispatch 0x7fa7c0000b90 command_reply(tid 1: 0 ) v1 2024-04-09T12:05:24.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.801+0000 7fa7bd7fa640 10 client.4283.objecter _finish_command 1 = system:0 2024-04-09T12:05:24.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.801+0000 7fa7bd7fa640 20 client.4283.objecter put_session s=0x7fa7a4072320 osd=1 4 2024-04-09T12:05:24.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.801+0000 7fa7bd7fa640 15 client.4283.objecter _session_command_op_remove 1 1 2024-04-09T12:05:24.808 INFO:teuthology.orchestra.run.smithi029.stdout:64424509446 2024-04-09T12:05:24.808 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-09T12:05:24.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.809+0000 7f6f81ffb640 1 -- 172.21.15.29:0/1614127035 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f88054ae0 con 0x7f6f8c065d80 2024-04-09T12:05:24.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.809+0000 7f6f81ffb640 10 monclient: handle_get_version_reply finishing 1 version 25 2024-04-09T12:05:24.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.810+0000 7f6f81ffb640 1 -- 172.21.15.29:0/1614127035 <== osd.3 v2:172.21.15.29:6816/35239 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f8c0b4670 con 0x7f6f700729c0 2024-04-09T12:05:24.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.810+0000 7f6f81ffb640 10 client.4351.objecter ms_dispatch 0x7f6f8c000b90 command_reply(tid 2: 0 ) v1 2024-04-09T12:05:24.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.810+0000 7f6f81ffb640 10 client.4351.objecter _finish_command 2 = system:0 2024-04-09T12:05:24.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.810+0000 7f6f81ffb640 20 client.4351.objecter put_session s=0x7f6f700722f0 osd=3 4 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.810+0000 7f6f81ffb640 15 client.4351.objecter _session_command_op_remove 3 2 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 10 librados: watch_flush enter 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 10 librados: watch_flush exit 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 10 client.4351.objecter close_session for osd.3 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 1 -- 172.21.15.29:0/1614127035 >> [v2:172.21.15.29:6816/35239,v1:172.21.15.29:6817/35239] conn(0x7f6f700729c0 msgr2=0x7f6f70074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.29:6816/35239,v1:172.21.15.29:6817/35239] conn(0x7f6f700729c0 0x7f6f70074de0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 20 client.4351.objecter put_session s=0x7f6f700722f0 osd=3 1 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 20 client.4351.objecter shutdown clearing up homeless session... 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 10 client.4351.objecter successfully canceled tick 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 1 -- 172.21.15.29:0/1614127035 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f6f7006c5e0 msgr2=0x7f6f7006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f6f7006c5e0 0x7f6f7006eaa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6f84035000 tx=0x7f6f8402e000 comp rx=0 tx=0).stop 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 10 monclient: shutdown 2024-04-09T12:05:24.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 1 -- 172.21.15.29:0/1614127035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f8c065d80 msgr2=0x7f6f8c1cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f938dc640 1 --2- 172.21.15.29:0/1614127035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f8c065d80 0x7f6f8c1cd880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800e9b0 tx=0x7f6f8800ee70 comp rx=0 tx=0).stop 2024-04-09T12:05:24.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.811+0000 7f6f91e79640 1 -- 172.21.15.29:0/1614127035 reap_dead start 2024-04-09T12:05:24.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.812+0000 7f6f938dc640 1 -- 172.21.15.29:0/1614127035 shutdown_connections 2024-04-09T12:05:24.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.812+0000 7f6f938dc640 1 -- 172.21.15.29:0/1614127035 >> 172.21.15.29:0/1614127035 conn(0x7f6f8c0b3d90 msgr2=0x7f6f8c0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.812+0000 7f6f938dc640 1 -- 172.21.15.29:0/1614127035 shutdown_connections 2024-04-09T12:05:24.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.812+0000 7f6f938dc640 1 -- 172.21.15.29:0/1614127035 wait complete. 2024-04-09T12:05:24.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.812+0000 7f6f938dc640 1 librados: shutdown 2024-04-09T12:05:24.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.827+0000 7fdc76b91640 10 client.4277.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-09T12:05:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.827+0000 7fdc76b91640 15 client.4277.objecter _session_command_op_assign -1 2 2024-04-09T12:05:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.827+0000 7fdc76b91640 20 client.4277.objecter _get_session s=0x7fdc54072c90 osd=7 3 2024-04-09T12:05:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.827+0000 7fdc76b91640 20 client.4277.objecter put_session s=0x7fdc54072c90 osd=7 3 2024-04-09T12:05:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.827+0000 7fdc76b91640 20 client.4277.objecter _get_session s=0x7fdc54072c90 osd=7 3 2024-04-09T12:05:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.827+0000 7fdc76b91640 15 client.4277.objecter _session_command_op_remove -1 2 2024-04-09T12:05:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.827+0000 7fdc76b91640 20 client.4277.objecter get_session s=0x7fdc54072c90 osd=7 3 2024-04-09T12:05:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.827+0000 7fdc76b91640 15 client.4277.objecter _session_command_op_assign 7 2 2024-04-09T12:05:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.827+0000 7fdc76b91640 20 client.4277.objecter put_session s=0x7fdc54072c90 osd=7 4 2024-04-09T12:05:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.827+0000 7fdc76b91640 10 client.4277.objecter _send_command 2 2024-04-09T12:05:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.827+0000 7fdc76b91640 1 -- 172.21.15.29:0/3890621766 --> [v2:172.21.15.173:6810/35532,v1:172.21.15.173:6811/35532] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdc70134670 con 0x7fdc54073360 2024-04-09T12:05:24.832 INFO:teuthology.orchestra.run.smithi029.stdout:64424509447 2024-04-09T12:05:24.832 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-09T12:05:24.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.829+0000 7fa7c6d47640 10 client.4283.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-09T12:05:24.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.829+0000 7fa7c6d47640 15 client.4283.objecter _session_command_op_assign -1 2 2024-04-09T12:05:24.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.829+0000 7fa7c6d47640 20 client.4283.objecter _get_session s=0x7fa7a4072320 osd=1 3 2024-04-09T12:05:24.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.829+0000 7fa7c6d47640 20 client.4283.objecter put_session s=0x7fa7a4072320 osd=1 3 2024-04-09T12:05:24.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.829+0000 7fa7c6d47640 20 client.4283.objecter _get_session s=0x7fa7a4072320 osd=1 3 2024-04-09T12:05:24.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.829+0000 7fa7c6d47640 15 client.4283.objecter _session_command_op_remove -1 2 2024-04-09T12:05:24.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.829+0000 7fa7c6d47640 20 client.4283.objecter get_session s=0x7fa7a4072320 osd=1 3 2024-04-09T12:05:24.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.829+0000 7fa7c6d47640 15 client.4283.objecter _session_command_op_assign 1 2 2024-04-09T12:05:24.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.829+0000 7fa7c6d47640 20 client.4283.objecter put_session s=0x7fa7a4072320 osd=1 4 2024-04-09T12:05:24.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.829+0000 7fa7c6d47640 10 client.4283.objecter _send_command 2 2024-04-09T12:05:24.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.829+0000 7fa7c6d47640 1 -- 172.21.15.29:0/1424952199 --> [v2:172.21.15.29:6824/35236,v1:172.21.15.29:6825/35236] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa7c0145480 con 0x7fa7a40729f0 2024-04-09T12:05:24.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.834+0000 7fdc6d7fa640 1 -- 172.21.15.29:0/3890621766 <== osd.7 v2:172.21.15.173:6810/35532 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdc70134670 con 0x7fdc54073360 2024-04-09T12:05:24.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.834+0000 7fdc6d7fa640 10 client.4277.objecter ms_dispatch 0x7fdc70000b90 command_reply(tid 2: 0 ) v1 2024-04-09T12:05:24.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.834+0000 7fdc6d7fa640 10 client.4277.objecter _finish_command 2 = system:0 2024-04-09T12:05:24.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.834+0000 7fdc6d7fa640 20 client.4277.objecter put_session s=0x7fdc54072c90 osd=7 4 2024-04-09T12:05:24.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.834+0000 7fdc6d7fa640 15 client.4277.objecter _session_command_op_remove 7 2 2024-04-09T12:05:24.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 10 librados: watch_flush enter 2024-04-09T12:05:24.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 10 librados: watch_flush exit 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 10 client.4277.objecter close_session for osd.7 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 1 -- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:6810/35532,v1:172.21.15.173:6811/35532] conn(0x7fdc54073360 msgr2=0x7fdc54075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:6810/35532,v1:172.21.15.173:6811/35532] conn(0x7fdc54073360 0x7fdc54075800 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 20 client.4277.objecter put_session s=0x7fdc54072c90 osd=7 1 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 20 client.4277.objecter shutdown clearing up homeless session... 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 10 client.4277.objecter successfully canceled tick 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 1 -- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fdc5406c5e0 msgr2=0x7fdc5406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fdc5406c5e0 0x7fdc5406eaa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009b40 tx=0x7fdc64009190 comp rx=0 tx=0).stop 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 10 monclient: shutdown 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 20 monclient: shutdown canceling and discarding version request 1 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 1 -- 172.21.15.29:0/3890621766 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdc70144c50 msgr2=0x7fdc701d62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.835+0000 7fdc76b91640 1 --2- 172.21.15.29:0/3890621766 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdc70144c50 0x7fdc701d62e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800ca80 tx=0x7fdc6800cf40 comp rx=0 tx=0).stop 2024-04-09T12:05:24.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.836+0000 7fdc7512e640 1 -- 172.21.15.29:0/3890621766 reap_dead start 2024-04-09T12:05:24.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.836+0000 7fdc76b91640 1 -- 172.21.15.29:0/3890621766 shutdown_connections 2024-04-09T12:05:24.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.836+0000 7fdc76b91640 1 -- 172.21.15.29:0/3890621766 >> 172.21.15.29:0/3890621766 conn(0x7fdc70065f30 msgr2=0x7fdc70138700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.836+0000 7fdc76b91640 1 -- 172.21.15.29:0/3890621766 shutdown_connections 2024-04-09T12:05:24.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.836+0000 7fdc76b91640 1 -- 172.21.15.29:0/3890621766 wait complete. 2024-04-09T12:05:24.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.836+0000 7fdc76b91640 1 librados: shutdown 2024-04-09T12:05:24.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.848+0000 7fa7bd7fa640 1 -- 172.21.15.29:0/1424952199 <== osd.1 v2:172.21.15.29:6824/35236 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa7b8007b90 con 0x7fa7a40729f0 2024-04-09T12:05:24.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.848+0000 7fa7bd7fa640 10 client.4283.objecter ms_dispatch 0x7fa7c0000b90 command_reply(tid 2: 0 ) v1 2024-04-09T12:05:24.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.848+0000 7fa7bd7fa640 10 client.4283.objecter _finish_command 2 = system:0 2024-04-09T12:05:24.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.848+0000 7fa7bd7fa640 20 client.4283.objecter put_session s=0x7fa7a4072320 osd=1 4 2024-04-09T12:05:24.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.848+0000 7fa7bd7fa640 15 client.4283.objecter _session_command_op_remove 1 2 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 10 librados: watch_flush enter 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 10 librados: watch_flush exit 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 10 client.4283.objecter close_session for osd.1 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 1 -- 172.21.15.29:0/1424952199 >> [v2:172.21.15.29:6824/35236,v1:172.21.15.29:6825/35236] conn(0x7fa7a40729f0 msgr2=0x7fa7a4074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.29:6824/35236,v1:172.21.15.29:6825/35236] conn(0x7fa7a40729f0 0x7fa7a4074e10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 20 client.4283.objecter put_session s=0x7fa7a4072320 osd=1 1 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 20 client.4283.objecter shutdown clearing up homeless session... 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 10 client.4283.objecter successfully canceled tick 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 1 -- 172.21.15.29:0/1424952199 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fa7a406c610 msgr2=0x7fa7a406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fa7a406c610 0x7fa7a406ead0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac036000 tx=0x7fa7ac03d040 comp rx=0 tx=0).stop 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 10 monclient: shutdown 2024-04-09T12:05:24.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 20 monclient: shutdown canceling and discarding version request 1 2024-04-09T12:05:24.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 1 -- 172.21.15.29:0/1424952199 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c00b4070 msgr2=0x7fa7c0137c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c6d47640 1 --2- 172.21.15.29:0/1424952199 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7c00b4070 0x7fa7c0137c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400c410 tx=0x7fa7b400c8d0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.849+0000 7fa7c52e4640 1 -- 172.21.15.29:0/1424952199 reap_dead start 2024-04-09T12:05:24.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.852+0000 7fa7c6d47640 1 -- 172.21.15.29:0/1424952199 shutdown_connections 2024-04-09T12:05:24.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.852+0000 7fa7c6d47640 1 -- 172.21.15.29:0/1424952199 >> 172.21.15.29:0/1424952199 conn(0x7fa7c0065cf0 msgr2=0x7fa7c00b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.852+0000 7fa7c6d47640 1 -- 172.21.15.29:0/1424952199 shutdown_connections 2024-04-09T12:05:24.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.852+0000 7fa7c6d47640 1 -- 172.21.15.29:0/1424952199 wait complete. 2024-04-09T12:05:24.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.852+0000 7fa7c6d47640 1 librados: shutdown 2024-04-09T12:05:24.858 INFO:teuthology.orchestra.run.smithi029.stdout:81604378633 2024-04-09T12:05:24.859 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-09T12:05:24.871 INFO:teuthology.orchestra.run.smithi029.stdout:90194313224 2024-04-09T12:05:24.871 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-09T12:05:24.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.877+0000 7f35967fc640 1 -- 172.21.15.29:0/1646390046 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f35a0060bd0 con 0x7f35980c3130 2024-04-09T12:05:24.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.878+0000 7f35967fc640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f358406c610 0x7f358406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.878+0000 7f35a5ad9640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f358406c610 0x7f358406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.878+0000 7f35a5ad9640 10 monclient: get_auth_request con 0x7f358406c610 auth_method 0 2024-04-09T12:05:24.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.879+0000 7f35967fc640 10 client.4286.objecter ms_handle_connect 0x7f358406c610 2024-04-09T12:05:24.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.879+0000 7f35a5ad9640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f358406c610 0x7f358406ead0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f359c036000 tx=0x7f359c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.910+0000 7f35967fc640 1 -- 172.21.15.29:0/1646390046 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f35a00d1f10 con 0x7f35980c3130 2024-04-09T12:05:24.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.910+0000 7f35967fc640 10 client.4286.objecter ms_dispatch 0x7f35a0000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:24.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.910+0000 7f35967fc640 3 client.4286.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:24.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.910+0000 7f35967fc640 3 client.4286.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:24.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 10 client.4286.objecter checking command 1 2024-04-09T12:05:24.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:6818/35529,v1:172.21.15.173:6819/35529] conn(0x7f35840729f0 0x7f3584074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 20 client.4286.objecter _get_session s=0x7f3584072320 osd=4 3 2024-04-09T12:05:24.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 20 client.4286.objecter put_session s=0x7f3584072320 osd=4 3 2024-04-09T12:05:24.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 15 client.4286.objecter _session_command_op_remove -1 1 2024-04-09T12:05:24.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 20 client.4286.objecter _get_session s=0x7f3584072320 osd=4 3 2024-04-09T12:05:24.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 20 client.4286.objecter get_session s=0x7f3584072320 osd=4 3 2024-04-09T12:05:24.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 15 client.4286.objecter _session_command_op_assign 4 1 2024-04-09T12:05:24.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 20 client.4286.objecter put_session s=0x7f3584072320 osd=4 4 2024-04-09T12:05:24.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 10 client.4286.objecter _send_command 1 2024-04-09T12:05:24.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 1 -- 172.21.15.29:0/1646390046 --> [v2:172.21.15.173:6818/35529,v1:172.21.15.173:6819/35529] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35840754c0 con 0x7f35840729f0 2024-04-09T12:05:24.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35967fc640 20 client.4286.objecter dump_active .. 0 homeless 2024-04-09T12:05:24.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.911+0000 7f35a52d8640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:6818/35529,v1:172.21.15.173:6819/35529] conn(0x7f35840729f0 0x7f3584074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.912+0000 7f35a52d8640 10 monclient: get_auth_request con 0x7f35840729f0 auth_method 0 2024-04-09T12:05:24.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.916+0000 7f35a52d8640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:6818/35529,v1:172.21.15.173:6819/35529] conn(0x7f35840729f0 0x7f3584074e10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.916+0000 7f35967fc640 10 client.4286.objecter ms_handle_connect 0x7f35840729f0 2024-04-09T12:05:24.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.961+0000 7fd239a71640 10 monclient: get_monmap_and_config 2024-04-09T12:05:24.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.961+0000 7fd239a71640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.961+0000 7fd239a71640 10 monclient: monmap: 2024-04-09T12:05:24.964 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.964 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.964 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.962618+0000 2024-04-09T12:05:24.965 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.962618+0000 2024-04-09T12:05:24.965 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.965 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.965 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:24.965 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:24.965 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:24.965 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:24.965 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:24.965 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.963+0000 7fd239a71640 1 Processor -- start 2024-04-09T12:05:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.963+0000 7fd239a71640 1 -- start start 2024-04-09T12:05:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.963+0000 7fd239a71640 10 monclient: init 2024-04-09T12:05:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2024-04-09T12:05:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd22c038fe0 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd22c035640 0x7fd22c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 10 monclient(hunting): picked mon.noname-b con 0x7fd22c035640 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd22c0cc600 0x7fd22c0d6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 10 monclient(hunting): picked mon.noname-c con 0x7fd22c0cc600 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c035bf0 con 0x7fd22c038fe0 2024-04-09T12:05:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c0c9d50 con 0x7fd22c0cc600 2024-04-09T12:05:24.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0393c0 con 0x7fd22c035640 2024-04-09T12:05:24.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.964+0000 7fd239a71640 10 monclient(hunting): authenticate will time out at 1391.084820s 2024-04-09T12:05:24.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.965+0000 7fd233fff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd22c035640 0x7fd22c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.966+0000 7fd233fff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd22c035640 0x7fd22c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39320/0 (socket says 172.21.15.29:39320) 2024-04-09T12:05:24.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.966+0000 7fd233fff640 1 -- 172.21.15.29:0/1904894881 learned_addr learned my addr 172.21.15.29:0/1904894881 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.966+0000 7fd233fff640 10 monclient(hunting): get_auth_request con 0x7fd22c035640 auth_method 0 2024-04-09T12:05:24.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.966+0000 7fd233fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.966+0000 7fd233fff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.966+0000 7fd233fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.967+0000 7fd233fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.967+0000 7fd233fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.968+0000 7fd233fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.972+0000 7fd233fff640 10 monclient(hunting): handle_auth_done global_id 4289 payload 274 2024-04-09T12:05:24.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.972+0000 7fd233fff640 1 -- 172.21.15.29:0/1904894881 >> v2:172.21.15.173:3300/0 conn(0x7fd22c0cc600 msgr2=0x7fd22c0d6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.972+0000 7fd233fff640 1 --2- 172.21.15.29:0/1904894881 >> v2:172.21.15.173:3300/0 conn(0x7fd22c0cc600 0x7fd22c0d6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.972+0000 7fd233fff640 1 -- 172.21.15.29:0/1904894881 >> v1:172.21.15.29:6789/0 conn(0x7fd22c038fe0 legacy=0x7fd22c0c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.972+0000 7fd233fff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.972+0000 7fd233fff640 1 monclient: found mon.noname-b 2024-04-09T12:05:24.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.972+0000 7fd233fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.972+0000 7fd233fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.972+0000 7fd233fff640 1 -- 172.21.15.29:0/1904894881 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0373e0 con 0x7fd22c035640 2024-04-09T12:05:24.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.976+0000 7fd233fff640 1 --2- 172.21.15.29:0/1904894881 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd22c035640 0x7fd22c0cc0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd220009870 tx=0x7fd22002b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4976ecd19790fb03 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:24.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.977+0000 7f5622304640 10 monclient: get_monmap_and_config 2024-04-09T12:05:24.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.977+0000 7f5622304640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.977+0000 7f5622304640 10 monclient: monmap: 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.978896+0000 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.978896+0000 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:24.981 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.976+0000 7f330bfff640 10 monclient: get_monmap_and_config 2024-04-09T12:05:24.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.976+0000 7f330bfff640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.976+0000 7f330bfff640 10 monclient: monmap: 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.978364+0000 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.978364+0000 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.978+0000 7f330bfff640 1 Processor -- start 2024-04-09T12:05:24.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.978+0000 7f330bfff640 1 -- start start 2024-04-09T12:05:24.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.978+0000 7f330bfff640 10 monclient: init 2024-04-09T12:05:24.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.978+0000 7f5622304640 1 Processor -- start 2024-04-09T12:05:24.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.978+0000 7f5622304640 1 -- start start 2024-04-09T12:05:24.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.978+0000 7f5622304640 10 monclient: init 2024-04-09T12:05:24.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2024-04-09T12:05:24.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:24.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 10 monclient: _add_conns ranks=[1,4,2,0,3] 2024-04-09T12:05:24.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f561c06d7b0 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:24.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f561c06db90 0x7f561c070100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 10 monclient(hunting): picked mon.noname-c con 0x7f561c06db90 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:24.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06e9a0 0x7f561c149530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f330c06e7d0 0x7f330c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 10 monclient(hunting): picked mon.noname-b con 0x7f561c06e9a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561c06e550 con 0x7f561c06d7b0 2024-04-09T12:05:24.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561c06d050 con 0x7f561c06db90 2024-04-09T12:05:24.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561c149010 con 0x7f561c06e9a0 2024-04-09T12:05:24.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f5622304640 10 monclient(hunting): authenticate will time out at 1391.099941s 2024-04-09T12:05:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f330c06e7d0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f330c0b3770 0x7f330c13aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f330c0b3770 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f330c13afa0 0x7f330c070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f330c13afa0 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c0705c0 con 0x7f330c0b3770 2024-04-09T12:05:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c06fa00 con 0x7f330c13afa0 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c06ed60 con 0x7f330c06e7d0 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.979+0000 7f330bfff640 10 monclient(hunting): authenticate will time out at 1391.099330s 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.981+0000 7f330affd640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f330c06e7d0 0x7f330c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.981+0000 7f330affd640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f330c06e7d0 0x7f330c06d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39330/0 (socket says 172.21.15.29:39330) 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.981+0000 7f330affd640 1 -- 172.21.15.29:0/1438398999 learned_addr learned my addr 172.21.15.29:0/1438398999 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.981+0000 7f330affd640 10 monclient(hunting): get_auth_request con 0x7f330c06e7d0 auth_method 0 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.981+0000 7f330affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.981+0000 7f330affd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.981+0000 7f330affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:24.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.982+0000 7f5621b03640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06e9a0 0x7f561c149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:24.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.982+0000 7f330affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:24.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.982+0000 7f330affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:24.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.982+0000 7f330affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd2337fe640 1 -- 172.21.15.29:0/1904894881 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200317e0 con 0x7fd22c035640 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd2337fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd2337fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd2337fe640 10 monclient: dump: 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:24.993 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd2337fe640 10 monclient: _finish_auth 0 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd2337fe640 10 monclient: _check_auth_tickets 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd2337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd239a71640 5 monclient: authenticate success, global_id 4289 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd239a71640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd2337fe640 1 -- 172.21.15.29:0/1904894881 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220031940 con 0x7fd22c035640 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd2337fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd239a71640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.983+0000 7fd239a71640 4 set_mon_vals no callback set 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.984+0000 7fd239a71640 10 monclient: shutdown 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.984+0000 7fd239a71640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:24.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.984+0000 7fd239a71640 1 -- 172.21.15.29:0/1904894881 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd22c035640 msgr2=0x7fd22c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:24.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.984+0000 7fd2337fe640 1 -- 172.21.15.29:0/1904894881 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200317e0 con 0x7fd22c035640 2024-04-09T12:05:24.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.984+0000 7fd239a71640 1 --2- 172.21.15.29:0/1904894881 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd22c035640 0x7fd22c0cc0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd220009870 tx=0x7fd22002b880 comp rx=0 tx=0).stop 2024-04-09T12:05:24.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.984+0000 7fd2337fe640 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2024-04-09T12:05:24.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7fd239a71640 1 -- 172.21.15.29:0/1904894881 shutdown_connections 2024-04-09T12:05:24.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7fd239a71640 1 --2- 172.21.15.29:0/1904894881 >> v2:172.21.15.173:3300/0 conn(0x7fd22c0cc600 0x7fd22c0d6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7fd239a71640 1 --2- 172.21.15.29:0/1904894881 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd22c035640 0x7fd22c0cc0c0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd220009870 tx=0x7fd22002b880 comp rx=0 tx=0).stop 2024-04-09T12:05:24.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7fd239a71640 1 -- 172.21.15.29:0/1904894881 >> 172.21.15.29:0/1904894881 conn(0x7fd22c0065d0 msgr2=0x7fd22c0069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:24.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7fd239a71640 1 -- 172.21.15.29:0/1904894881 shutdown_connections 2024-04-09T12:05:24.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7f330affd640 10 monclient(hunting): handle_auth_done global_id 4292 payload 274 2024-04-09T12:05:24.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7f330affd640 1 -- 172.21.15.29:0/1438398999 >> v2:172.21.15.173:3300/0 conn(0x7f330c13afa0 msgr2=0x7f330c070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7f330affd640 1 --2- 172.21.15.29:0/1438398999 >> v2:172.21.15.173:3300/0 conn(0x7f330c13afa0 0x7f330c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7f330affd640 1 -- 172.21.15.29:0/1438398999 >> v2:172.21.15.29:3300/0 conn(0x7f330c0b3770 msgr2=0x7f330c13aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:24.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7f330affd640 1 --2- 172.21.15.29:0/1438398999 >> v2:172.21.15.29:3300/0 conn(0x7f330c0b3770 0x7f330c13aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:24.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7f330affd640 10 monclient: _finish_hunting 0 2024-04-09T12:05:24.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7f330affd640 1 monclient: found mon.noname-b 2024-04-09T12:05:24.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7f330affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:24.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7f330affd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:24.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7f330affd640 1 -- 172.21.15.29:0/1438398999 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c140ad0 con 0x7f330c06e7d0 2024-04-09T12:05:24.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.985+0000 7fd239a71640 1 -- 172.21.15.29:0/1904894881 wait complete. 2024-04-09T12:05:24.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.986+0000 7fd239a71640 10 monclient: build_initial_monmap 2024-04-09T12:05:24.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.986+0000 7fd239a71640 10 monclient: monmap: 2024-04-09T12:05:24.999 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:24.999 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:24.999 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:24.999 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:24.999 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:24.999 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:24.999 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:24.999 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:24.999 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:24.999 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.987+0000 7fd239a71640 1 librados: starting msgr at 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.987+0000 7fd239a71640 1 librados: starting objecter 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.987+0000 7fd239a71640 1 Processor -- start 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.987+0000 7fd239a71640 1 -- start start 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.987+0000 7fd239a71640 1 librados: setting wanted keys 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.987+0000 7fd239a71640 1 librados: calling monclient init 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.987+0000 7fd239a71640 10 monclient: init 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd22c038fe0 0x7fd22c02d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 10 monclient(hunting): picked mon.noname-c con 0x7fd22c038fe0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd22c0cc600 0x7fd22c02fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 10 monclient(hunting): picked mon.noname-a con 0x7fd22c0cc600 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:25.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd22c0c8a70 0x7fd22c0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 10 monclient(hunting): picked mon.noname-b con 0x7fd22c0c8a70 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:25.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7f5621b03640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06e9a0 0x7f561c149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39340/0 (socket says 172.21.15.29:39340) 2024-04-09T12:05:25.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7f5621b03640 1 -- 172.21.15.29:0/737174016 learned_addr learned my addr 172.21.15.29:0/737174016 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7f5621b03640 10 monclient(hunting): get_auth_request con 0x7f561c06e9a0 auth_method 0 2024-04-09T12:05:25.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7f5621b03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7f5621b03640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7f5621b03640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c02da20 con 0x7fd22c0cc600 2024-04-09T12:05:25.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0cc070 con 0x7fd22c0c8a70 2024-04-09T12:05:25.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0cb370 con 0x7fd22c038fe0 2024-04-09T12:05:25.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.988+0000 7fd239a71640 10 monclient(hunting): authenticate will time out at 1391.108462s 2024-04-09T12:05:25.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.989+0000 7f5621b03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.989+0000 7f5621b03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.989+0000 7f5621b03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.991+0000 7f5621b03640 10 monclient(hunting): handle_auth_done global_id 4295 payload 274 2024-04-09T12:05:25.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.991+0000 7f5621b03640 1 -- 172.21.15.29:0/737174016 >> v2:172.21.15.173:3300/0 conn(0x7f561c06db90 msgr2=0x7f561c070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:25.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.992+0000 7f5621b03640 1 --2- 172.21.15.29:0/737174016 >> v2:172.21.15.173:3300/0 conn(0x7f561c06db90 0x7f561c070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.992+0000 7f5621b03640 1 -- 172.21.15.29:0/737174016 >> v1:172.21.15.173:6789/0 conn(0x7f561c06d7b0 legacy=0x7f561c142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:25.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.992+0000 7f5621b03640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.992+0000 7f5621b03640 1 monclient: found mon.noname-b 2024-04-09T12:05:25.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.992+0000 7f5621b03640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.992+0000 7f5621b03640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:25.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.992+0000 7f5621b03640 1 -- 172.21.15.29:0/737174016 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c1434b0 con 0x7f561c06e9a0 2024-04-09T12:05:25.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.994+0000 7f330affd640 1 --2- 172.21.15.29:0/1438398999 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f330c06e7d0 0x7f330c06d990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f330c13e630 tx=0x7f330002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=566ea38b19acc66f server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.994+0000 7fae5359e640 10 monclient: get_monmap_and_config 2024-04-09T12:05:25.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.994+0000 7fae5359e640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.994+0000 7fae5359e640 10 monclient: monmap: 2024-04-09T12:05:25.006 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.006 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.006 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:24.996323+0000 2024-04-09T12:05:25.006 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:24.996323+0000 2024-04-09T12:05:25.006 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.007 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.007 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:25.007 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:25.007 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:25.008 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:25.008 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:25.008 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.995+0000 7fae5359e640 1 Processor -- start 2024-04-09T12:05:25.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.995+0000 7fae5359e640 1 -- start start 2024-04-09T12:05:25.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.995+0000 7fae5359e640 10 monclient: init 2024-04-09T12:05:25.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2024-04-09T12:05:25.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fae4c036df0 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:25.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fd233fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd22c0cc600 0x7fd22c02fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4c0c3300 0x7fae4c0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 10 monclient(hunting): picked mon.noname-b con 0x7fae4c0c3300 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fae4c0355b0 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:25.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c02e6b0 con 0x7fae4c036df0 2024-04-09T12:05:25.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c02e990 con 0x7fae4c0355b0 2024-04-09T12:05:25.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.997+0000 7f5621b03640 1 --2- 172.21.15.29:0/737174016 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06e9a0 0x7f561c149530 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5614009e50 tx=0x7f561402bdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce29ea560b0b22d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0371d0 con 0x7fae4c0c3300 2024-04-09T12:05:25.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.996+0000 7fae5359e640 10 monclient(hunting): authenticate will time out at 1391.116740s 2024-04-09T12:05:25.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.998+0000 7fd233fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd22c0cc600 0x7fd22c02fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48126/0 (socket says 172.21.15.29:48126) 2024-04-09T12:05:25.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.998+0000 7fd233fff640 1 -- 172.21.15.29:0/4282116622 learned_addr learned my addr 172.21.15.29:0/4282116622 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.998+0000 7fd233fff640 10 monclient(hunting): get_auth_request con 0x7fd22c0cc600 auth_method 0 2024-04-09T12:05:25.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.998+0000 7fd233fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.998+0000 7fd233fff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:24.998+0000 7fd233fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.000+0000 7fd233fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.000+0000 7fd233fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.000+0000 7fd233fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.002+0000 7fd239270640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd22c0c8a70 0x7fd22c0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.003+0000 7fd239270640 10 monclient(hunting): get_auth_request con 0x7fd22c0c8a70 auth_method 0 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.003+0000 7fd239270640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.003+0000 7fd239270640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.003+0000 7fd239270640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.003+0000 7fd239270640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.003+0000 7fd239270640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.003+0000 7fd239270640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.004+0000 7fd233fff640 10 monclient(hunting): handle_auth_done global_id 4296 payload 824 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.004+0000 7fd233fff640 1 -- 172.21.15.29:0/4282116622 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd22c038fe0 msgr2=0x7fd22c02d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.004+0000 7fd233fff640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd22c038fe0 0x7fd22c02d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.004+0000 7fd233fff640 1 -- 172.21.15.29:0/4282116622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd22c0c8a70 msgr2=0x7fd22c0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.004+0000 7fd233fff640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd22c0c8a70 0x7fd22c0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.004+0000 7fd233fff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.004+0000 7fd233fff640 1 monclient: found mon.noname-a 2024-04-09T12:05:25.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.004+0000 7fd233fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.004+0000 7fd233fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.004+0000 7fd233fff640 1 -- 172.21.15.29:0/4282116622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200094d0 con 0x7fd22c0cc600 2024-04-09T12:05:25.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f3309ffb640 1 -- 172.21.15.29:0/1438398999 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300031890 con 0x7f330c06e7d0 2024-04-09T12:05:25.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f3309ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f3309ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:25.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f3309ffb640 10 monclient: dump: 2024-04-09T12:05:25.017 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.017 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.017 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f3309ffb640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f3309ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f3309ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f330bfff640 5 monclient: authenticate success, global_id 4292 2024-04-09T12:05:25.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f330bfff640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f3309ffb640 1 -- 172.21.15.29:0/1438398999 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33000319f0 con 0x7f330c06e7d0 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f3309ffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f330bfff640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.006+0000 7f330bfff640 4 set_mon_vals no callback set 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f3309ffb640 1 -- 172.21.15.29:0/1438398999 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300031dc0 con 0x7f330c06e7d0 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f3309ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f3309ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f3309ffb640 10 monclient: dump: 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.019 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f330bfff640 10 monclient: shutdown 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f330bfff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f330bfff640 1 -- 172.21.15.29:0/1438398999 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f330c06e7d0 msgr2=0x7f330c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f330bfff640 1 --2- 172.21.15.29:0/1438398999 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f330c06e7d0 0x7f330c06d990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f330c13e630 tx=0x7f330002b930 comp rx=0 tx=0).stop 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f330bfff640 1 -- 172.21.15.29:0/1438398999 shutdown_connections 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f330bfff640 1 --2- 172.21.15.29:0/1438398999 >> v2:172.21.15.173:3300/0 conn(0x7f330c13afa0 0x7f330c070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f330bfff640 1 --2- 172.21.15.29:0/1438398999 >> v2:172.21.15.29:3300/0 conn(0x7f330c0b3770 0x7f330c13aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f330bfff640 1 --2- 172.21.15.29:0/1438398999 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f330c06e7d0 0x7f330c06d990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f330bfff640 1 -- 172.21.15.29:0/1438398999 >> 172.21.15.29:0/1438398999 conn(0x7f330c0b2c80 msgr2=0x7f330c0b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f330bfff640 1 -- 172.21.15.29:0/1438398999 shutdown_connections 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.007+0000 7f330bfff640 1 -- 172.21.15.29:0/1438398999 wait complete. 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.008+0000 7f330bfff640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.008+0000 7f330bfff640 10 monclient: monmap: 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:25.022 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.008+0000 7fae5259c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fae4c036df0 0x7fae4c0c2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59234/0 (socket says 172.21.15.29:59234) 2024-04-09T12:05:25.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.008+0000 7fae5259c640 1 -- 172.21.15.29:0/2943025671 learned_addr learned my addr 172.21.15.29:0/2943025671 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:25.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.008+0000 7f330bfff640 1 librados: starting msgr at 2024-04-09T12:05:25.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.008+0000 7f330bfff640 1 librados: starting objecter 2024-04-09T12:05:25.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 1 Processor -- start 2024-04-09T12:05:25.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 1 -- start start 2024-04-09T12:05:25.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 1 librados: setting wanted keys 2024-04-09T12:05:25.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 1 librados: calling monclient init 2024-04-09T12:05:25.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 10 monclient: init 2024-04-09T12:05:25.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7fe6f49c8640 10 monclient: get_monmap_and_config 2024-04-09T12:05:25.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7fe6f49c8640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7fe6f49c8640 10 monclient: monmap: 2024-04-09T12:05:25.023 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.023 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.024 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:25.011245+0000 2024-04-09T12:05:25.024 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:25.011245+0000 2024-04-09T12:05:25.024 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.024 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.024 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:25.024 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:25.024 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:25.024 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:25.024 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:25.024 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f330c0b3770 0x7f330c12a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f330c0b3770 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f330c1de2a0 0x7f330c1de700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f330c1de2a0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f330c1daaa0 0x7f330c1daf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f330c1daaa0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0aa440 con 0x7f330c0b3770 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c12b3a0 con 0x7f330c1de2a0 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c12b8f0 con 0x7f330c1daaa0 2024-04-09T12:05:25.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.009+0000 7f330bfff640 10 monclient(hunting): authenticate will time out at 1391.129803s 2024-04-09T12:05:25.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.010+0000 7fe6f49c8640 1 Processor -- start 2024-04-09T12:05:25.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.010+0000 7fe6f49c8640 1 -- start start 2024-04-09T12:05:25.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.010+0000 7fe6f49c8640 10 monclient: init 2024-04-09T12:05:25.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fd233fff640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd22c0cc600 0x7fd22c02fc00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd22002b8c0 tx=0x7fd2200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fd2317fa640 10 client.?.objecter ms_handle_connect 0x7fd22c0cc600 2024-04-09T12:05:25.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fd2317fa640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:25.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 10 monclient: _add_conns ranks=[2,3,1,0,4] 2024-04-09T12:05:25.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6e8038d80 0x7fe6e80c5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 10 monclient(hunting): picked mon.noname-b con 0x7fe6e8038d80 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe6e8039160 0x7fe6e80c8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 10 monclient(hunting): picked mon.noname-a con 0x7fe6e8039160 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:25.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe6e80c5770 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:25.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e80c7e70 con 0x7fe6e80c5770 2024-04-09T12:05:25.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e8037610 con 0x7fe6e8039160 2024-04-09T12:05:25.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8035440 con 0x7fe6e8038d80 2024-04-09T12:05:25.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7fe6f49c8640 10 monclient(hunting): authenticate will time out at 1391.131533s 2024-04-09T12:05:25.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7f35967fc640 1 -- 172.21.15.29:0/1646390046 <== osd.4 v2:172.21.15.173:6818/35529 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f35840754c0 con 0x7f35840729f0 2024-04-09T12:05:25.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7f35967fc640 10 client.4286.objecter ms_dispatch 0x7f35a0000b90 command_reply(tid 1: 0 ) v1 2024-04-09T12:05:25.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7f35967fc640 10 client.4286.objecter _finish_command 1 = system:0 2024-04-09T12:05:25.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7f35967fc640 20 client.4286.objecter put_session s=0x7f3584072320 osd=4 4 2024-04-09T12:05:25.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.011+0000 7f35967fc640 15 client.4286.objecter _session_command_op_remove 4 1 2024-04-09T12:05:25.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.012+0000 7f330a7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f330c1de2a0 0x7f330c1de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.012+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145071181 0 0) 0x7fae4c02e6b0 con 0x7fae4c036df0 2024-04-09T12:05:25.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.012+0000 7fae5159a640 10 monclient(hunting): _negotiate 2024-04-09T12:05:25.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.012+0000 7fae5159a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.012+0000 7fae5159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.012+0000 7fae5159a640 10 monclient(hunting): my global_id is 4299 2024-04-09T12:05:25.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.012+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae3c003520 con 0x7fae4c036df0 2024-04-09T12:05:25.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.013+0000 7fae51d9b640 1 --2- 172.21.15.29:0/2943025671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4c0c3300 0x7fae4c0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.014+0000 7fe6eeffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe6e8039160 0x7fe6e80c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.014+0000 7f330a7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f330c1de2a0 0x7f330c1de700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:41106/0 (socket says 172.21.15.29:41106) 2024-04-09T12:05:25.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.014+0000 7f330a7fc640 1 -- 172.21.15.29:0/561650916 learned_addr learned my addr 172.21.15.29:0/561650916 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.014+0000 7f330a7fc640 10 monclient(hunting): get_auth_request con 0x7f330c1de2a0 auth_method 0 2024-04-09T12:05:25.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.014+0000 7f330a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.014+0000 7f330a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.014+0000 7f330a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.014+0000 7fe6effff640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe6e80c5770 0x7fe6e80cb2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:46362/0 (socket says 172.21.15.29:46362) 2024-04-09T12:05:25.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.014+0000 7fe6effff640 1 -- 172.21.15.29:0/4272161904 learned_addr learned my addr 172.21.15.29:0/4272161904 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:25.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.015+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987698506 0 0) 0x7fae4c02e990 con 0x7fae4c0355b0 2024-04-09T12:05:25.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.015+0000 7fae5159a640 10 monclient(hunting): _negotiate 2024-04-09T12:05:25.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.015+0000 7fae5159a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.015+0000 7fae5159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.015+0000 7fae5159a640 10 monclient(hunting): my global_id is 4366 2024-04-09T12:05:25.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.015+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae4c02e6b0 con 0x7fae4c0355b0 2024-04-09T12:05:25.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.015+0000 7f330a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.015+0000 7f330a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.015+0000 7f330a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.018+0000 7f330a7fc640 10 monclient(hunting): handle_auth_done global_id 4369 payload 824 2024-04-09T12:05:25.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.018+0000 7f330a7fc640 1 -- 172.21.15.29:0/561650916 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f330c1daaa0 msgr2=0x7f330c1daf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.018+0000 7f330a7fc640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f330c1daaa0 0x7f330c1daf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.018+0000 7f330a7fc640 1 -- 172.21.15.29:0/561650916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f330c0b3770 msgr2=0x7f330c12a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.018+0000 7f330a7fc640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f330c0b3770 0x7f330c12a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.018+0000 7f330a7fc640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.018+0000 7f330a7fc640 1 monclient: found mon.noname-b 2024-04-09T12:05:25.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.018+0000 7f330a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.018+0000 7f330a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.018+0000 7f330a7fc640 1 -- 172.21.15.29:0/561650916 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000094d0 con 0x7f330c1de2a0 2024-04-09T12:05:25.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 <== mon.1 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186310183 0 0) 0x7fae4c02e6b0 con 0x7fae4c0355b0 2024-04-09T12:05:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4c0c3300 msgr2=0x7fae4c0c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 --2- 172.21.15.29:0/2943025671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4c0c3300 0x7fae4c0c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 >> v1:172.21.15.29:6789/0 conn(0x7fae4c036df0 legacy=0x7fae4c0c2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 monclient: found mon.noname-c-legacy 2024-04-09T12:05:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.173:6789/0 2024-04-09T12:05:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0c9b50 con 0x7fae4c0355b0 2024-04-09T12:05:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 <== mon.1 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412254180 0 0) 0x7fae5404e680 con 0x7fae4c0355b0 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient: dump: 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.037 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.038 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] but i'm connected to v1:172.21.15.173:6789/0, reconnecting 2024-04-09T12:05:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 >> v1:172.21.15.173:6789/0 conn(0x7fae4c0355b0 legacy=0x7fae4c0c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-09T12:05:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 --2- 172.21.15.29:0/2943025671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae3c003b00 0x7fae3c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient(hunting): picked mon.c con 0x7fae3c003b00 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 --2- 172.21.15.29:0/2943025671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae3c0047c0 0x7fae3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient(hunting): picked mon.a con 0x7fae3c0047c0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 --2- 172.21.15.29:0/2943025671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae3c005180 0x7fae3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient(hunting): picked mon.b con 0x7fae3c005180 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0371d0 con 0x7fae3c0047c0 2024-04-09T12:05:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c00bf70 con 0x7fae3c005180 2024-04-09T12:05:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c00c130 con 0x7fae3c003b00 2024-04-09T12:05:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fae5159a640 10 monclient(hunting): _finish_auth 0 2024-04-09T12:05:25.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.023+0000 7fe6eeffd640 10 monclient(hunting): get_auth_request con 0x7fe6e8039160 auth_method 0 2024-04-09T12:05:25.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.024+0000 7fe6eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.024+0000 7fe6eeffd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.024+0000 7fe6eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.024+0000 7fe6ee7fc640 1 -- 172.21.15.29:0/4272161904 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491209944 0 0) 0x7fe6e80c7e70 con 0x7fe6e80c5770 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.024+0000 7fe6ee7fc640 10 monclient(hunting): _negotiate 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.024+0000 7fe6ee7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.024+0000 7fe6ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.024+0000 7fe6ee7fc640 10 monclient(hunting): my global_id is 4372 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.024+0000 7fe6ee7fc640 1 -- 172.21.15.29:0/4272161904 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6e0003520 con 0x7fe6e80c5770 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.025+0000 7fe6eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.025+0000 7fe6eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.025+0000 7fe6eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.029+0000 7fe6eeffd640 10 monclient(hunting): handle_auth_done global_id 4302 payload 274 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.029+0000 7fe6eeffd640 1 -- 172.21.15.29:0/4272161904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6e8038d80 msgr2=0x7fe6e80c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.029+0000 7fe6eeffd640 1 --2- 172.21.15.29:0/4272161904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6e8038d80 0x7fe6e80c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.029+0000 7fe6eeffd640 1 -- 172.21.15.29:0/4272161904 >> v1:172.21.15.173:6789/0 conn(0x7fe6e80c5770 legacy=0x7fe6e80cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.029+0000 7fe6eeffd640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.029+0000 7fe6eeffd640 1 monclient: found mon.noname-a 2024-04-09T12:05:25.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.029+0000 7fe6eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.029+0000 7fe6eeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.029+0000 7fe6eeffd640 1 -- 172.21.15.29:0/4272161904 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8035870 con 0x7fe6e8039160 2024-04-09T12:05:25.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.029+0000 7fae52d9d640 1 --2- 172.21.15.29:0/2943025671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae3c005180 0x7fae3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.029+0000 7fd2317fa640 1 -- 172.21.15.29:0/4282116622 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200317e0 con 0x7fd22c0cc600 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 10 monclient: dump: 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.043 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd239a71640 5 monclient: authenticate success, global_id 4296 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd239a71640 10 monclient: _renew_subs 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd239a71640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd239a71640 1 -- 172.21.15.29:0/4282116622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c034070 con 0x7fd22c0cc600 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd239a71640 10 client.4296.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd239a71640 10 monclient: _renew_subs 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd239a71640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd239a71640 1 -- 172.21.15.29:0/4282116622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c02e550 con 0x7fd22c0cc600 2024-04-09T12:05:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd239a71640 1 librados: init done 2024-04-09T12:05:25.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fae51d9b640 1 --2- 172.21.15.29:0/2943025671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae3c0047c0 0x7fae3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fae51d9b640 10 monclient(hunting): get_auth_request con 0x7fae3c0047c0 auth_method 0 2024-04-09T12:05:25.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fae51d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fae51d9b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fae51d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:05:25.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fae52d9d640 10 monclient(hunting): get_auth_request con 0x7fae3c005180 auth_method 0 2024-04-09T12:05:25.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fae52d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fae52d9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fae52d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-09T12:05:25.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7f330a7fc640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f330c1de2a0 0x7f330c1de700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00b4b0 tx=0x7f32fc00b970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7f32f37fe640 10 client.?.objecter ms_handle_connect 0x7f330c1de2a0 2024-04-09T12:05:25.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7f32f37fe640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:25.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 1 -- 172.21.15.29:0/4282116622 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22003f070 con 0x7fd22c0cc600 2024-04-09T12:05:25.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 1 -- 172.21.15.29:0/4282116622 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220003a10 con 0x7fd22c0cc600 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2317fa640 10 monclient: dump: 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.048 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.030+0000 7fd2327fc640 4 set_mon_vals no callback set 2024-04-09T12:05:25.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fd239a71640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fd239a71640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fd239a71640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.031+0000 7fd239a71640 1 -- 172.21.15.29:0/4282116622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd214005040 con 0x7fd22c0cc600 2024-04-09T12:05:25.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7f3583fff640 10 client.4286.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-09T12:05:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7f3583fff640 15 client.4286.objecter _session_command_op_assign -1 2 2024-04-09T12:05:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7f3583fff640 20 client.4286.objecter _get_session s=0x7f3584072320 osd=4 3 2024-04-09T12:05:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7f3583fff640 20 client.4286.objecter put_session s=0x7f3584072320 osd=4 3 2024-04-09T12:05:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7f3583fff640 20 client.4286.objecter _get_session s=0x7f3584072320 osd=4 3 2024-04-09T12:05:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7f3583fff640 15 client.4286.objecter _session_command_op_remove -1 2 2024-04-09T12:05:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7f3583fff640 20 client.4286.objecter get_session s=0x7f3584072320 osd=4 3 2024-04-09T12:05:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7f3583fff640 15 client.4286.objecter _session_command_op_assign 4 2 2024-04-09T12:05:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7f3583fff640 20 client.4286.objecter put_session s=0x7f3584072320 osd=4 4 2024-04-09T12:05:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7f3583fff640 10 client.4286.objecter _send_command 2 2024-04-09T12:05:25.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7f3583fff640 1 -- 172.21.15.29:0/1646390046 --> [v2:172.21.15.173:6818/35529,v1:172.21.15.173:6819/35529] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f357c0011c0 con 0x7f35840729f0 2024-04-09T12:05:25.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.033+0000 7fe6eeffd640 1 --2- 172.21.15.29:0/4272161904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6e8039160 0x7fe6e80c8320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0097d0 tx=0x7fe6dc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953348e4df22a5c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 1 -- 172.21.15.29:0/561650916 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc010610 con 0x7f330c1de2a0 2024-04-09T12:05:25.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:25.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 10 monclient: dump: 2024-04-09T12:05:25.051 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.051 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 1 -- 172.21.15.29:0/561650916 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc010770 con 0x7f330c1de2a0 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f330bfff640 5 monclient: authenticate success, global_id 4369 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f330bfff640 10 monclient: _renew_subs 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f330bfff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f33097fa640 4 set_mon_vals no callback set 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f330bfff640 1 -- 172.21.15.29:0/561650916 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c12b610 con 0x7f330c1de2a0 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f330bfff640 10 client.4369.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f330bfff640 10 monclient: _renew_subs 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f330bfff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f330bfff640 1 -- 172.21.15.29:0/561650916 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c1dec40 con 0x7f330c1de2a0 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f330bfff640 1 librados: init done 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 1 -- 172.21.15.29:0/561650916 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc010b20 con 0x7f330c1de2a0 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f32f37fe640 10 monclient: dump: 2024-04-09T12:05:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.054 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f0ca8edc640 10 monclient: get_monmap_and_config 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f0ca8edc640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.034+0000 7f0ca8edc640 10 monclient: monmap: 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:25.036456+0000 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:25.036456+0000 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:25.055 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.035+0000 7fae52d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.035+0000 7fae52d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.035+0000 7fae52d9d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-04-09T12:05:25.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.035+0000 7f0ca8edc640 1 Processor -- start 2024-04-09T12:05:25.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.035+0000 7f0ca8edc640 1 -- start start 2024-04-09T12:05:25.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.035+0000 7f0ca8edc640 10 monclient: init 2024-04-09T12:05:25.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f330bfff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f330bfff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f330bfff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f330bfff640 1 -- 172.21.15.29:0/561650916 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c04e160 con 0x7f330c1de2a0 2024-04-09T12:05:25.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2024-04-09T12:05:25.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40ae710 0x7f0ca413ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 10 monclient(hunting): picked mon.noname-b con 0x7f0ca40ae710 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0ca40711e0 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0ca413b220 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca4071730 con 0x7f0ca40711e0 2024-04-09T12:05:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca4070520 con 0x7f0ca413b220 2024-04-09T12:05:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca413b690 con 0x7f0ca40ae710 2024-04-09T12:05:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.036+0000 7f0ca8edc640 10 monclient(hunting): authenticate will time out at 1391.156607s 2024-04-09T12:05:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7f5d03cdc640 10 monclient: get_monmap_and_config 2024-04-09T12:05:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7f5d03cdc640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7f5d03cdc640 10 monclient: monmap: 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:25.038973+0000 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:25.038973+0000 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:25.060 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 10 monclient(hunting): handle_auth_done global_id 4366 payload 293 2024-04-09T12:05:25.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 1 -- 172.21.15.29:0/2943025671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae3c003b00 msgr2=0x7fae3c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:25.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 1 --2- 172.21.15.29:0/2943025671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae3c003b00 0x7fae3c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 1 -- 172.21.15.29:0/2943025671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae3c0047c0 msgr2=0x7fae3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 1 --2- 172.21.15.29:0/2943025671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae3c0047c0 0x7fae3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 1 monclient: found mon.b 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 1 -- 172.21.15.29:0/2943025671 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0c9b50 con 0x7fae3c005180 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae52d9d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae5359e640 5 monclient: authenticate success, global_id 4366 2024-04-09T12:05:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.037+0000 7fae5359e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:25.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 1 Processor -- start 2024-04-09T12:05:25.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 1 -- start start 2024-04-09T12:05:25.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 10 monclient: init 2024-04-09T12:05:25.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 10 monclient: _add_conns ranks=[3,0,4,2,1] 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5cfc0b7b10 0x7f5cfc0a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 10 monclient(hunting): picked mon.noname-a con 0x7f5cfc0b7b10 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5cfc0a8f10 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5cfc13f1b0 0x7f5cfc144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 10 monclient(hunting): picked mon.noname-c con 0x7f5cfc13f1b0 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cfc0aa840 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cfc0b7ef0 con 0x7f5cfc0b7b10 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cfc0a93c0 con 0x7f5cfc13f1b0 2024-04-09T12:05:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.038+0000 7f5d03cdc640 10 monclient(hunting): authenticate will time out at 1391.158912s 2024-04-09T12:05:25.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f35967fc640 1 -- 172.21.15.29:0/1646390046 <== osd.4 v2:172.21.15.173:6818/35529 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f357c0011c0 con 0x7f35840729f0 2024-04-09T12:05:25.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f35967fc640 10 client.4286.objecter ms_dispatch 0x7f35a0000b90 command_reply(tid 2: 0 ) v1 2024-04-09T12:05:25.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f35967fc640 10 client.4286.objecter _finish_command 2 = system:0 2024-04-09T12:05:25.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f35967fc640 20 client.4286.objecter put_session s=0x7f3584072320 osd=4 4 2024-04-09T12:05:25.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f35967fc640 15 client.4286.objecter _session_command_op_remove 4 2 2024-04-09T12:05:25.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 10 librados: watch_flush enter 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 10 librados: watch_flush exit 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 10 client.4286.objecter close_session for osd.4 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 1 -- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:6818/35529,v1:172.21.15.173:6819/35529] conn(0x7f35840729f0 msgr2=0x7f3584074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:6818/35529,v1:172.21.15.173:6819/35529] conn(0x7f35840729f0 0x7f3584074e10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 20 client.4286.objecter put_session s=0x7f3584072320 osd=4 1 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 20 client.4286.objecter shutdown clearing up homeless session... 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 10 client.4286.objecter successfully canceled tick 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 1 -- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f358406c610 msgr2=0x7f358406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f358406c610 0x7f358406ead0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f359c036000 tx=0x7f359c030000 comp rx=0 tx=0).stop 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 10 monclient: shutdown 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 20 monclient: shutdown canceling and discarding version request 1 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 1 -- 172.21.15.29:0/1646390046 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35980c3130 msgr2=0x7f35980332a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f3583fff640 1 --2- 172.21.15.29:0/1646390046 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35980c3130 0x7f35980332a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f35a004f940 tx=0x7f35a0067180 comp rx=0 tx=0).stop 2024-04-09T12:05:25.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.046+0000 7f35a62da640 1 -- 172.21.15.29:0/1646390046 reap_dead start 2024-04-09T12:05:25.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.047+0000 7f3583fff640 1 -- 172.21.15.29:0/1646390046 shutdown_connections 2024-04-09T12:05:25.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.047+0000 7f3583fff640 1 -- 172.21.15.29:0/1646390046 >> 172.21.15.29:0/1646390046 conn(0x7f3598006390 msgr2=0x7f35980362c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:25.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.047+0000 7f3583fff640 1 -- 172.21.15.29:0/1646390046 shutdown_connections 2024-04-09T12:05:25.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.047+0000 7f3583fff640 1 -- 172.21.15.29:0/1646390046 wait complete. 2024-04-09T12:05:25.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.047+0000 7f3583fff640 1 librados: shutdown 2024-04-09T12:05:25.072 INFO:teuthology.orchestra.run.smithi029.stdout:85899345930 2024-04-09T12:05:25.072 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-09T12:05:25.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 1 -- 172.21.15.29:0/737174016 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561402c960 con 0x7f561c06e9a0 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 10 monclient: dump: 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.077 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 1 -- 172.21.15.29:0/737174016 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561402cac0 con 0x7f561c06e9a0 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 1 -- 172.21.15.29:0/737174016 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561402ce50 con 0x7f561c06e9a0 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5613fff640 10 monclient: dump: 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.078 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.079 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.079 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.079 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.079 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.079 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.079 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.079 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.079 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.073+0000 7f5622304640 5 monclient: authenticate success, global_id 4295 2024-04-09T12:05:25.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:25.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 4 set_mon_vals no callback set 2024-04-09T12:05:25.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 10 monclient: shutdown 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 1 -- 172.21.15.29:0/737174016 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06e9a0 msgr2=0x7f561c149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 1 --2- 172.21.15.29:0/737174016 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06e9a0 0x7f561c149530 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5614009e50 tx=0x7f561402bdc0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 1 -- 172.21.15.29:0/737174016 shutdown_connections 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 1 --2- 172.21.15.29:0/737174016 >> v2:172.21.15.173:3300/0 conn(0x7f561c06db90 0x7f561c070100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 1 --2- 172.21.15.29:0/737174016 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06e9a0 0x7f561c149530 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 1 -- 172.21.15.29:0/737174016 >> 172.21.15.29:0/737174016 conn(0x7f561c0b2c80 msgr2=0x7f561c0b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 1 -- 172.21.15.29:0/737174016 shutdown_connections 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.074+0000 7f5622304640 1 -- 172.21.15.29:0/737174016 wait complete. 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.076+0000 7f5622304640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.076+0000 7f5622304640 10 monclient: monmap: 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.076+0000 7f5622304640 1 librados: starting msgr at 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.076+0000 7f5622304640 1 librados: starting objecter 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.076+0000 7f5622304640 1 Processor -- start 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.077+0000 7f5622304640 1 -- start start 2024-04-09T12:05:25.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.077+0000 7f5622304640 1 librados: setting wanted keys 2024-04-09T12:05:25.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.077+0000 7f5622304640 1 librados: calling monclient init 2024-04-09T12:05:25.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.077+0000 7f5622304640 10 monclient: init 2024-04-09T12:05:25.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:05:25.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f561c06d7b0 0x7f561c145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 10 monclient(hunting): picked mon.noname-b con 0x7f561c06d7b0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06db90 0x7f561c0b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 10 monclient(hunting): picked mon.noname-c con 0x7f561c06db90 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f561c06e9a0 0x7f561c145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 10 monclient(hunting): picked mon.noname-a con 0x7f561c06e9a0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c1469e0 con 0x7f561c06e9a0 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c145700 con 0x7f561c06d7b0 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561c13ca20 con 0x7f561c06db90 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.078+0000 7f5622304640 10 monclient(hunting): authenticate will time out at 1391.198842s 2024-04-09T12:05:25.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.083+0000 7f0ca259c640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40ae710 0x7f0ca413ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.084+0000 7f5620b01640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06db90 0x7f561c0b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.084+0000 7f0ca259c640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40ae710 0x7f0ca413ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39406/0 (socket says 172.21.15.29:39406) 2024-04-09T12:05:25.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.084+0000 7f0ca259c640 1 -- 172.21.15.29:0/3606119533 learned_addr learned my addr 172.21.15.29:0/3606119533 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.084+0000 7f0ca259c640 10 monclient(hunting): get_auth_request con 0x7f0ca40ae710 auth_method 0 2024-04-09T12:05:25.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.084+0000 7f0ca259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.084+0000 7f0ca259c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.084+0000 7f0ca259c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.085+0000 7f0ca259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.085+0000 7f0ca259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.085+0000 7f0ca259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.085+0000 7f5620b01640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06db90 0x7f561c0b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39410/0 (socket says 172.21.15.29:39410) 2024-04-09T12:05:25.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.085+0000 7f5620b01640 1 -- 172.21.15.29:0/1717451794 learned_addr learned my addr 172.21.15.29:0/1717451794 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.085+0000 7f5620b01640 10 monclient(hunting): get_auth_request con 0x7f561c06db90 auth_method 0 2024-04-09T12:05:25.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.085+0000 7f5620b01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.085+0000 7f5620b01640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.085+0000 7f5620b01640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.087+0000 7f0ca259c640 10 monclient(hunting): handle_auth_done global_id 4298 payload 274 2024-04-09T12:05:25.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.087+0000 7f0ca259c640 1 -- 172.21.15.29:0/3606119533 >> v1:172.21.15.173:6789/0 conn(0x7f0ca413b220 legacy=0x7f0ca4141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:25.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.087+0000 7f0ca259c640 1 -- 172.21.15.29:0/3606119533 >> v1:172.21.15.29:6789/0 conn(0x7f0ca40711e0 legacy=0x7f0ca4140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:25.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.087+0000 7f0ca259c640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.087+0000 7f0ca259c640 1 monclient: found mon.noname-b 2024-04-09T12:05:25.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.087+0000 7f0ca259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.087+0000 7f0ca259c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:25.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.087+0000 7f0ca259c640 1 -- 172.21.15.29:0/3606119533 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4070800 con 0x7f0ca40ae710 2024-04-09T12:05:25.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.090+0000 7f5620b01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.090+0000 7f5620b01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.090+0000 7f5620b01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.090+0000 7f0ca259c640 1 --2- 172.21.15.29:0/3606119533 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40ae710 0x7f0ca413ace0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009e80 tx=0x7f0c9402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a67c8e6d5ce5aa78 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.093+0000 7f5620b01640 10 monclient(hunting): handle_auth_done global_id 4301 payload 824 2024-04-09T12:05:25.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.093+0000 7f5620b01640 1 -- 172.21.15.29:0/1717451794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f561c06d7b0 msgr2=0x7f561c145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.093+0000 7f5620b01640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f561c06d7b0 0x7f561c145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.093+0000 7f5620b01640 1 -- 172.21.15.29:0/1717451794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f561c06e9a0 msgr2=0x7f561c145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.093+0000 7f5620b01640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f561c06e9a0 0x7f561c145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.093+0000 7f5620b01640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.093+0000 7f5620b01640 1 monclient: found mon.noname-c 2024-04-09T12:05:25.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.093+0000 7f5620b01640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.093+0000 7f5620b01640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:05:25.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.093+0000 7f5620b01640 1 -- 172.21.15.29:0/1717451794 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5614009b30 con 0x7f561c06db90 2024-04-09T12:05:25.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.097+0000 7f5620b01640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06db90 0x7f561c0b1d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f560c00b4a0 tx=0x7f560c00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.097+0000 7f5611ffb640 10 client.?.objecter ms_handle_connect 0x7f561c06db90 2024-04-09T12:05:25.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.097+0000 7f5611ffb640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:25.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 1 -- 172.21.15.29:0/3606119533 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9402c9c0 con 0x7f0ca40ae710 2024-04-09T12:05:25.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 10 monclient: dump: 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 1 -- 172.21.15.29:0/3606119533 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9402cb20 con 0x7f0ca40ae710 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 1 -- 172.21.15.29:0/3606119533 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940343f0 con 0x7f0ca40ae710 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca159a640 10 monclient: dump: 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.108 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.108 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.108 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.108 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca8edc640 5 monclient: authenticate success, global_id 4298 2024-04-09T12:05:25.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca8edc640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:25.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.102+0000 7f0ca8edc640 4 set_mon_vals no callback set 2024-04-09T12:05:25.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.103+0000 7f0ca8edc640 10 monclient: shutdown 2024-04-09T12:05:25.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.103+0000 7f0ca8edc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:25.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.103+0000 7f0ca8edc640 1 -- 172.21.15.29:0/3606119533 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40ae710 msgr2=0x7f0ca413ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.103+0000 7f0ca8edc640 1 --2- 172.21.15.29:0/3606119533 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40ae710 0x7f0ca413ace0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009e80 tx=0x7f0c9402be20 comp rx=0 tx=0).stop 2024-04-09T12:05:25.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.104+0000 7f0ca8edc640 1 -- 172.21.15.29:0/3606119533 shutdown_connections 2024-04-09T12:05:25.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.104+0000 7f0ca8edc640 1 --2- 172.21.15.29:0/3606119533 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40ae710 0x7f0ca413ace0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.104+0000 7f0ca8edc640 1 -- 172.21.15.29:0/3606119533 >> 172.21.15.29:0/3606119533 conn(0x7f0ca40b3210 msgr2=0x7f0ca40b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.104+0000 7f0ca8edc640 1 -- 172.21.15.29:0/3606119533 shutdown_connections 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.104+0000 7f0ca8edc640 1 -- 172.21.15.29:0/3606119533 wait complete. 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.104+0000 7f0ca8edc640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.105+0000 7f0ca8edc640 10 monclient: monmap: 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.105+0000 7f0ca8edc640 1 librados: starting msgr at 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.105+0000 7f0ca8edc640 1 librados: starting objecter 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.105+0000 7f0ca8edc640 1 Processor -- start 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.105+0000 7f0ca8edc640 1 -- start start 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.105+0000 7f0ca8edc640 1 librados: setting wanted keys 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.105+0000 7f0ca8edc640 1 librados: calling monclient init 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.105+0000 7f0ca8edc640 10 monclient: init 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40711e0 0x7f0ca413e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 10 monclient(hunting): picked mon.noname-c con 0x7f0ca40711e0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca40ae710 0x7f0ca4136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 10 monclient(hunting): picked mon.noname-a con 0x7f0ca40ae710 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca413b220 0x7f0ca4137010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 10 monclient(hunting): picked mon.noname-b con 0x7f0ca413b220 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4137cb0 con 0x7f0ca40ae710 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4138140 con 0x7f0ca413b220 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4135e70 con 0x7f0ca40711e0 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.106+0000 7f0ca8edc640 10 monclient(hunting): authenticate will time out at 1391.226226s 2024-04-09T12:05:25.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 1 -- 172.21.15.29:0/1717451794 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c010610 con 0x7f561c06db90 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 10 monclient: dump: 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.116 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 1 -- 172.21.15.29:0/1717451794 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c010770 con 0x7f561c06db90 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 1 -- 172.21.15.29:0/1717451794 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c010b20 con 0x7f561c06db90 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5611ffb640 10 monclient: dump: 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.118 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f56137fe640 4 set_mon_vals no callback set 2024-04-09T12:05:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5622304640 5 monclient: authenticate success, global_id 4301 2024-04-09T12:05:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5622304640 10 monclient: _renew_subs 2024-04-09T12:05:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5622304640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:25.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.109+0000 7f0ca259c640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40711e0 0x7f0ca413e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5622304640 1 -- 172.21.15.29:0/1717451794 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561c146150 con 0x7f561c06db90 2024-04-09T12:05:25.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5622304640 10 client.4301.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:25.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5622304640 10 monclient: _renew_subs 2024-04-09T12:05:25.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5622304640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:25.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.108+0000 7f5622304640 1 -- 172.21.15.29:0/1717451794 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561c1465b0 con 0x7f561c06db90 2024-04-09T12:05:25.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.109+0000 7f5622304640 1 librados: init done 2024-04-09T12:05:25.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.110+0000 7f5622304640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.110+0000 7f5622304640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.110+0000 7f5622304640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:25.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.110+0000 7f5622304640 1 -- 172.21.15.29:0/1717451794 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561c13cca0 con 0x7f561c06db90 2024-04-09T12:05:25.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.110+0000 7f0ca259c640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40711e0 0x7f0ca413e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:39416/0 (socket says 172.21.15.29:39416) 2024-04-09T12:05:25.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.110+0000 7f0ca259c640 1 -- 172.21.15.29:0/2780152114 learned_addr learned my addr 172.21.15.29:0/2780152114 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.110+0000 7f0ca259c640 10 monclient(hunting): get_auth_request con 0x7f0ca40711e0 auth_method 0 2024-04-09T12:05:25.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.110+0000 7f0ca259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.110+0000 7f0ca259c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.110+0000 7f0ca259c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.135+0000 7f0ca259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.135+0000 7f0ca259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.135+0000 7f0ca259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.149+0000 7f5611ffb640 1 -- 172.21.15.29:0/1717451794 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f560c010c80 con 0x7f561c06db90 2024-04-09T12:05:25.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.149+0000 7f5611ffb640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f560006c5e0 0x7f560006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.150+0000 7f5621302640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f560006c5e0 0x7f560006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.150+0000 7f5621302640 10 monclient: get_auth_request con 0x7f560006c5e0 auth_method 0 2024-04-09T12:05:25.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.150+0000 7f5621302640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f560006c5e0 0x7f560006eaa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5618001560 tx=0x7f5618007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.150+0000 7f5611ffb640 10 client.4301.objecter ms_handle_connect 0x7f560006c5e0 2024-04-09T12:05:25.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.180+0000 7fef80e64640 10 monclient: get_monmap_and_config 2024-04-09T12:05:25.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.180+0000 7fef80e64640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.180+0000 7fef80e64640 10 monclient: monmap: 2024-04-09T12:05:25.183 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.183 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.183 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:25.181694+0000 2024-04-09T12:05:25.184 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:25.181694+0000 2024-04-09T12:05:25.184 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.184 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.184 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:25.184 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:25.185 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:25.185 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:25.185 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:25.185 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.180+0000 7fef80e64640 1 Processor -- start 2024-04-09T12:05:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.180+0000 7fef80e64640 1 -- start start 2024-04-09T12:05:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.180+0000 7fef80e64640 10 monclient: init 2024-04-09T12:05:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2024-04-09T12:05:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef7c0b7b10 0x7fef7c0a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 10 monclient(hunting): picked mon.noname-b con 0x7fef7c0b7b10 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fef7c0a8f10 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fef7c13f1b0 0x7fef7c144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 10 monclient(hunting): picked mon.noname-c con 0x7fef7c13f1b0 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c0aa840 con 0x7fef7c0a8f10 2024-04-09T12:05:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c0b7ef0 con 0x7fef7c13f1b0 2024-04-09T12:05:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0a93c0 con 0x7fef7c0b7b10 2024-04-09T12:05:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.181+0000 7fef80e64640 10 monclient(hunting): authenticate will time out at 1391.301662s 2024-04-09T12:05:25.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.270+0000 7fae52d9d640 1 --2- 172.21.15.29:0/2943025671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae3c005180 0x7fae3c00b980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae54063c30 tx=0x7fae3c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aec98849a71ebc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.282+0000 7f32f37fe640 1 -- 172.21.15.29:0/561650916 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f32fc010c80 con 0x7f330c1de2a0 2024-04-09T12:05:25.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.282+0000 7f32f37fe640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f32f806c5e0 0x7f32f806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.283+0000 7f330affd640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f32f806c5e0 0x7f32f806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.283+0000 7f330affd640 10 monclient: get_auth_request con 0x7f32f806c5e0 auth_method 0 2024-04-09T12:05:25.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.283+0000 7f330affd640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f32f806c5e0 0x7f32f806eaa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3300036000 tx=0x7f3300030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.283+0000 7f32f37fe640 10 client.4369.objecter ms_handle_connect 0x7f32f806c5e0 2024-04-09T12:05:25.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.284+0000 7f32f37fe640 1 -- 172.21.15.29:0/561650916 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f32fc058980 con 0x7f330c1de2a0 2024-04-09T12:05:25.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.284+0000 7f32f37fe640 10 client.4369.objecter ms_dispatch 0x7f330c000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.284+0000 7f32f37fe640 3 client.4369.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.284+0000 7f32f37fe640 3 client.4369.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.284+0000 7f32f37fe640 20 client.4369.objecter dump_active .. 0 homeless 2024-04-09T12:05:25.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.296+0000 7f32f37fe640 1 -- 172.21.15.29:0/561650916 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f32fc0545c0 con 0x7f330c1de2a0 2024-04-09T12:05:25.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.296+0000 7f32f37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.296+0000 7f32f37fe640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:25.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae540a77b0 con 0x7fae3c005180 2024-04-09T12:05:25.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5159a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:25.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5159a640 10 monclient: dump: 2024-04-09T12:05:25.303 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.303 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.303 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.303 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.303 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.303 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5359e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae540a7910 con 0x7fae3c005180 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5159a640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5359e640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5159a640 1 -- 172.21.15.29:0/2943025671 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae540a7d80 con 0x7fae3c005180 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5359e640 4 set_mon_vals no callback set 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5159a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5159a640 10 monclient: dump: 2024-04-09T12:05:25.304 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.305 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.305 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.305 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.305 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.305 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.305 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.305 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.305 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.305 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7f5d02279640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5cfc13f1b0 0x7f5cfc144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5359e640 10 monclient: shutdown 2024-04-09T12:05:25.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5359e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:25.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5359e640 1 -- 172.21.15.29:0/2943025671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae3c005180 msgr2=0x7fae3c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5359e640 1 --2- 172.21.15.29:0/2943025671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae3c005180 0x7fae3c00b980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae54063c30 tx=0x7fae3c0057f0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae52d9d640 1 -- 172.21.15.29:0/2943025671 reap_dead start 2024-04-09T12:05:25.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.300+0000 7fae5359e640 1 -- 172.21.15.29:0/2943025671 shutdown_connections 2024-04-09T12:05:25.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.301+0000 7fae5359e640 1 -- 172.21.15.29:0/2943025671 >> 172.21.15.29:0/2943025671 conn(0x7fae4c006390 msgr2=0x7fae4c0067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:25.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.301+0000 7f5d02279640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5cfc13f1b0 0x7f5cfc144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:41130/0 (socket says 172.21.15.29:41130) 2024-04-09T12:05:25.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.301+0000 7f5d02279640 1 -- 172.21.15.29:0/3990995623 learned_addr learned my addr 172.21.15.29:0/3990995623 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.301+0000 7f5d02279640 10 monclient(hunting): get_auth_request con 0x7f5cfc13f1b0 auth_method 0 2024-04-09T12:05:25.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.301+0000 7f5d02279640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.301+0000 7f5d02279640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.301+0000 7f5d02279640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.301+0000 7fae5359e640 1 -- 172.21.15.29:0/2943025671 shutdown_connections 2024-04-09T12:05:25.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.301+0000 7fae5359e640 1 -- 172.21.15.29:0/2943025671 wait complete. 2024-04-09T12:05:25.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7f5d02279640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7f5d02279640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7f5d02279640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7fae5359e640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7fae5359e640 10 monclient: monmap: 2024-04-09T12:05:25.310 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.310 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:25.311 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:25.311 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:25.311 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.311 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.311 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:25.311 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:25.311 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:25.311 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7fae5359e640 1 librados: starting msgr at 2024-04-09T12:05:25.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7fae5359e640 1 librados: starting objecter 2024-04-09T12:05:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7fae5359e640 1 Processor -- start 2024-04-09T12:05:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7fae5359e640 1 -- start start 2024-04-09T12:05:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7fae5359e640 1 librados: setting wanted keys 2024-04-09T12:05:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7fae5359e640 1 librados: calling monclient init 2024-04-09T12:05:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.302+0000 7fae5359e640 10 monclient: init 2024-04-09T12:05:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-09T12:05:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae3c005180 0x7fae4c0c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 10 monclient(hunting): picked mon.noname-c con 0x7fae3c005180 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4c0c64e0 0x7fae4c0097a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 10 monclient(hunting): picked mon.noname-b con 0x7fae4c0c64e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:25.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4c0c3780 0x7fae4c0c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 10 monclient(hunting): picked mon.noname-a con 0x7fae4c0c3780 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:25.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0c60c0 con 0x7fae4c0c3780 2024-04-09T12:05:25.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0c5790 con 0x7fae4c0c64e0 2024-04-09T12:05:25.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0c5db0 con 0x7fae3c005180 2024-04-09T12:05:25.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.303+0000 7fae5359e640 10 monclient(hunting): authenticate will time out at 1391.423722s 2024-04-09T12:05:25.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.304+0000 7fef7ad9d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fef7c13f1b0 0x7fef7c144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.305+0000 7fef7ad9d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fef7c13f1b0 0x7fef7c144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:41166/0 (socket says 172.21.15.29:41166) 2024-04-09T12:05:25.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.305+0000 7fef7ad9d640 1 -- 172.21.15.29:0/4200729316 learned_addr learned my addr 172.21.15.29:0/4200729316 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.305+0000 7fef7ad9d640 10 monclient(hunting): get_auth_request con 0x7fef7c13f1b0 auth_method 0 2024-04-09T12:05:25.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.305+0000 7fef7ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.305+0000 7fef7ad9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.305+0000 7fef7ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.307+0000 7f5d02279640 10 monclient(hunting): handle_auth_done global_id 4375 payload 274 2024-04-09T12:05:25.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.307+0000 7f5d02279640 1 -- 172.21.15.29:0/3990995623 >> v2:172.21.15.29:3300/0 conn(0x7f5cfc0b7b10 msgr2=0x7f5cfc0a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:25.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.307+0000 7f5d02279640 1 --2- 172.21.15.29:0/3990995623 >> v2:172.21.15.29:3300/0 conn(0x7f5cfc0b7b10 0x7f5cfc0a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.307+0000 7f5d02279640 1 -- 172.21.15.29:0/3990995623 >> v1:172.21.15.29:6789/0 conn(0x7f5cfc0a8f10 legacy=0x7f5cfc13eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:25.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.307+0000 7f5d02279640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.307+0000 7f5d02279640 1 monclient: found mon.noname-c 2024-04-09T12:05:25.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.307+0000 7f5d02279640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.307+0000 7f5d02279640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.307+0000 7f5d02279640 1 -- 172.21.15.29:0/3990995623 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc1452a0 con 0x7f5cfc13f1b0 2024-04-09T12:05:25.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.308+0000 7fef7ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.308+0000 7fef7ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.308+0000 7fef7ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.308+0000 7f0ca2d9d640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca413b220 0x7f0ca4137010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.309+0000 7f0ca2d9d640 10 monclient(hunting): get_auth_request con 0x7f0ca413b220 auth_method 0 2024-04-09T12:05:25.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.309+0000 7f0ca2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.309+0000 7f0ca2d9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.309+0000 7f0ca2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.310+0000 7fef7ad9d640 10 monclient(hunting): handle_auth_done global_id 4378 payload 274 2024-04-09T12:05:25.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.310+0000 7fef7ad9d640 1 -- 172.21.15.29:0/4200729316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef7c0b7b10 msgr2=0x7fef7c0a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:25.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.310+0000 7fef7ad9d640 1 --2- 172.21.15.29:0/4200729316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef7c0b7b10 0x7fef7c0a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.310+0000 7fef7ad9d640 1 -- 172.21.15.29:0/4200729316 >> v1:172.21.15.173:6789/0 conn(0x7fef7c0a8f10 legacy=0x7fef7c13eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.310+0000 7fef7ad9d640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.310+0000 7fef7ad9d640 1 monclient: found mon.noname-c 2024-04-09T12:05:25.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.310+0000 7fef7ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.310+0000 7fef7ad9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.310+0000 7fef7ad9d640 1 -- 172.21.15.29:0/4200729316 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c1452a0 con 0x7fef7c13f1b0 2024-04-09T12:05:25.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.311+0000 7f0ca2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.311+0000 7f0ca2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.311+0000 7f0ca2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.312+0000 7fae51d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4c0c64e0 0x7fae4c0097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.312+0000 7fae51d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4c0c64e0 0x7fae4c0097a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:41182/0 (socket says 172.21.15.29:41182) 2024-04-09T12:05:25.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.312+0000 7fae51d9b640 1 -- 172.21.15.29:0/209149643 learned_addr learned my addr 172.21.15.29:0/209149643 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.312+0000 7fae51d9b640 10 monclient(hunting): get_auth_request con 0x7fae4c0c64e0 auth_method 0 2024-04-09T12:05:25.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.312+0000 7fae51d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.312+0000 7fae51d9b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.312+0000 7fae51d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.316+0000 7f0ca2d9d640 10 monclient(hunting): handle_auth_done global_id 4381 payload 824 2024-04-09T12:05:25.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.316+0000 7f0ca2d9d640 1 -- 172.21.15.29:0/2780152114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40711e0 msgr2=0x7f0ca413e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.316+0000 7f0ca2d9d640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40711e0 0x7f0ca413e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.316+0000 7f0ca2d9d640 1 -- 172.21.15.29:0/2780152114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca40ae710 msgr2=0x7f0ca4136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.316+0000 7f0ca2d9d640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca40ae710 0x7f0ca4136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.316+0000 7f0ca2d9d640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.316+0000 7f0ca2d9d640 1 monclient: found mon.noname-b 2024-04-09T12:05:25.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.316+0000 7f0ca2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.316+0000 7f0ca2d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.316+0000 7f0ca2d9d640 1 -- 172.21.15.29:0/2780152114 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c94009b30 con 0x7f0ca413b220 2024-04-09T12:05:25.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.318+0000 7fef7ad9d640 1 --2- 172.21.15.29:0/4200729316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c13f1b0 0x7fef7c144d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fef74009e50 tx=0x7fef7402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc8b2dc9b8ad6fa server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.318+0000 7fae51d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.318+0000 7fae51d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.318+0000 7fae51d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.319+0000 7fd2317fa640 1 -- 172.21.15.29:0/4282116622 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd220003b70 con 0x7fd22c0cc600 2024-04-09T12:05:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.319+0000 7fd2317fa640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd21806c5e0 0x7fd21806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.319+0000 7fd238a6f640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd21806c5e0 0x7fd21806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.319+0000 7fd238a6f640 10 monclient: get_auth_request con 0x7fd21806c5e0 auth_method 0 2024-04-09T12:05:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.320+0000 7fd2317fa640 10 client.4296.objecter ms_handle_connect 0x7fd21806c5e0 2024-04-09T12:05:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.320+0000 7fd238a6f640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd21806c5e0 0x7fd21806eaa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd228001560 tx=0x7fd228007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.321+0000 7f5d02279640 1 --2- 172.21.15.29:0/3990995623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cfc13f1b0 0x7f5cfc144d60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009e50 tx=0x7f5cf402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cae66c149008092 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.324+0000 7fae51d9b640 10 monclient(hunting): handle_auth_done global_id 4384 payload 824 2024-04-09T12:05:25.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.324+0000 7fae51d9b640 1 -- 172.21.15.29:0/209149643 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae3c005180 msgr2=0x7fae4c0c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.324+0000 7fae51d9b640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae3c005180 0x7fae4c0c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.324+0000 7fae51d9b640 1 -- 172.21.15.29:0/209149643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4c0c3780 msgr2=0x7fae4c0c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.324+0000 7fae51d9b640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4c0c3780 0x7fae4c0c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.324+0000 7fae51d9b640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.324+0000 7fae51d9b640 1 monclient: found mon.noname-b 2024-04-09T12:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.324+0000 7fae51d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.324+0000 7fae51d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.324+0000 7fae51d9b640 1 -- 172.21.15.29:0/209149643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0c5990 con 0x7fae4c0c64e0 2024-04-09T12:05:25.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 1 -- 172.21.15.29:0/4200729316 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7402cb00 con 0x7fef7c13f1b0 2024-04-09T12:05:25.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 10 monclient: dump: 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 1 -- 172.21.15.29:0/4200729316 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7402cc60 con 0x7fef7c13f1b0 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef80e64640 5 monclient: authenticate success, global_id 4378 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef80e64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef80e64640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 1 -- 172.21.15.29:0/4200729316 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef740343f0 con 0x7fef7c13f1b0 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef80e64640 4 set_mon_vals no callback set 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.327+0000 7fef7959a640 10 monclient: dump: 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.328+0000 7fef80e64640 10 monclient: shutdown 2024-04-09T12:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.328+0000 7fef80e64640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.328+0000 7fef80e64640 1 -- 172.21.15.29:0/4200729316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c13f1b0 msgr2=0x7fef7c144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.328+0000 7fef80e64640 1 --2- 172.21.15.29:0/4200729316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c13f1b0 0x7fef7c144d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fef74009e50 tx=0x7fef7402bf60 comp rx=0 tx=0).stop 2024-04-09T12:05:25.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.328+0000 7fef80e64640 1 -- 172.21.15.29:0/4200729316 shutdown_connections 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.328+0000 7fef80e64640 1 --2- 172.21.15.29:0/4200729316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c13f1b0 0x7fef7c144d60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.328+0000 7fef80e64640 1 --2- 172.21.15.29:0/4200729316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef7c0b7b10 0x7fef7c0a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.328+0000 7fef80e64640 1 -- 172.21.15.29:0/4200729316 >> 172.21.15.29:0/4200729316 conn(0x7fef7c066140 msgr2=0x7fef7c0b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.328+0000 7fef80e64640 1 -- 172.21.15.29:0/4200729316 shutdown_connections 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.328+0000 7fef80e64640 1 -- 172.21.15.29:0/4200729316 wait complete. 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7fef80e64640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7fef80e64640 10 monclient: monmap: 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:25.336 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:25.336 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:25.336 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7fef80e64640 1 librados: starting msgr at 2024-04-09T12:05:25.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7fef80e64640 1 librados: starting objecter 2024-04-09T12:05:25.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7fef80e64640 1 Processor -- start 2024-04-09T12:05:25.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7fef80e64640 1 -- start start 2024-04-09T12:05:25.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7fef80e64640 1 librados: setting wanted keys 2024-04-09T12:05:25.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7fef80e64640 1 librados: calling monclient init 2024-04-09T12:05:25.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7fef80e64640 10 monclient: init 2024-04-09T12:05:25.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7f0ca2d9d640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca413b220 0x7f0ca4137010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00b410 tx=0x7f0c9c00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7f0c92ffd640 10 client.?.objecter ms_handle_connect 0x7f0ca413b220 2024-04-09T12:05:25.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.329+0000 7f0c92ffd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:25.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-09T12:05:25.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef7c0a8f10 0x7fef7c0b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 10 monclient(hunting): picked mon.noname-c con 0x7fef7c0a8f10 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef7c0b7b10 0x7fef7c13fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 10 monclient(hunting): picked mon.noname-a con 0x7fef7c0b7b10 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:25.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c13f1b0 0x7fef7c0b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 10 monclient(hunting): picked mon.noname-b con 0x7fef7c13f1b0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:25.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0b71f0 con 0x7fef7c0b7b10 2024-04-09T12:05:25.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c13b910 con 0x7fef7c13f1b0 2024-04-09T12:05:25.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c13aed0 con 0x7fef7c0a8f10 2024-04-09T12:05:25.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.330+0000 7fef80e64640 10 monclient(hunting): authenticate will time out at 1391.450382s 2024-04-09T12:05:25.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.333+0000 7fae51d9b640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4c0c64e0 0x7fae4c0097a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fae4800e5a0 tx=0x7fae4800ea60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.333+0000 7fae42ffd640 10 client.?.objecter ms_handle_connect 0x7fae4c0c64e0 2024-04-09T12:05:25.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.333+0000 7fae42ffd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:25.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.334+0000 7fd2317fa640 1 -- 172.21.15.29:0/4282116622 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd220003e20 con 0x7fd22c0cc600 2024-04-09T12:05:25.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.334+0000 7fd2317fa640 10 client.4296.objecter ms_dispatch 0x7fd234000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:25.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.334+0000 7fd2317fa640 3 client.4296.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:25.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.334+0000 7fd2317fa640 3 client.4296.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:25.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.334+0000 7fd2317fa640 20 client.4296.objecter dump_active .. 0 homeless 2024-04-09T12:05:25.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.334+0000 7fd2317fa640 1 -- 172.21.15.29:0/4282116622 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fd220076c80 con 0x7fd22c0cc600 2024-04-09T12:05:25.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.334+0000 7fd2317fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.334+0000 7fd2317fa640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:25.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 1 -- 172.21.15.29:0/3990995623 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf402ca80 con 0x7f5cfc13f1b0 2024-04-09T12:05:25.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7fef7ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c13f1b0 0x7fef7c0b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:25.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 10 monclient: dump: 2024-04-09T12:05:25.343 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.343 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.343 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.343 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.343 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.344 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.344 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.344 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.344 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.344 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 1 -- 172.21.15.29:0/3990995623 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf402cbe0 con 0x7f5cfc13f1b0 2024-04-09T12:05:25.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d03cdc640 5 monclient: authenticate success, global_id 4375 2024-04-09T12:05:25.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d03cdc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:25.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d03cdc640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:25.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 1 -- 172.21.15.29:0/3990995623 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40343f0 con 0x7f5cfc13f1b0 2024-04-09T12:05:25.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d03cdc640 4 set_mon_vals no callback set 2024-04-09T12:05:25.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:25.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.337+0000 7f5d00a76640 10 monclient: dump: 2024-04-09T12:05:25.345 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.338+0000 7f5d03cdc640 10 monclient: shutdown 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.338+0000 7f5d03cdc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:25.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.338+0000 7f5d03cdc640 1 -- 172.21.15.29:0/3990995623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cfc13f1b0 msgr2=0x7f5cfc144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.338+0000 7f5d03cdc640 1 --2- 172.21.15.29:0/3990995623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cfc13f1b0 0x7f5cfc144d60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009e50 tx=0x7f5cf402bee0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.338+0000 7f5d03cdc640 1 -- 172.21.15.29:0/3990995623 shutdown_connections 2024-04-09T12:05:25.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.338+0000 7f5d03cdc640 1 --2- 172.21.15.29:0/3990995623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cfc13f1b0 0x7f5cfc144d60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.338+0000 7f5d03cdc640 1 --2- 172.21.15.29:0/3990995623 >> v2:172.21.15.29:3300/0 conn(0x7f5cfc0b7b10 0x7f5cfc0a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.338+0000 7f5d03cdc640 1 -- 172.21.15.29:0/3990995623 >> 172.21.15.29:0/3990995623 conn(0x7f5cfc066140 msgr2=0x7f5cfc0b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:25.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.339+0000 7f5d03cdc640 1 -- 172.21.15.29:0/3990995623 shutdown_connections 2024-04-09T12:05:25.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.339+0000 7f5d03cdc640 1 -- 172.21.15.29:0/3990995623 wait complete. 2024-04-09T12:05:25.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.339+0000 7fef7ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c13f1b0 0x7fef7c0b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:41194/0 (socket says 172.21.15.29:41194) 2024-04-09T12:05:25.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.339+0000 7fef7ad9d640 1 -- 172.21.15.29:0/2106819537 learned_addr learned my addr 172.21.15.29:0/2106819537 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.339+0000 7fef7ad9d640 10 monclient(hunting): get_auth_request con 0x7fef7c13f1b0 auth_method 0 2024-04-09T12:05:25.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.339+0000 7fef7ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.339+0000 7fef7ad9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.339+0000 7fef7ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.339+0000 7f5d03cdc640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.339+0000 7f5d03cdc640 10 monclient: monmap: 2024-04-09T12:05:25.348 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.348 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:25.348 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:25.349 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7fef7ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7fef7ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7fef7ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f5d03cdc640 1 librados: starting msgr at 2024-04-09T12:05:25.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f5d03cdc640 1 librados: starting objecter 2024-04-09T12:05:25.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f5d03cdc640 1 Processor -- start 2024-04-09T12:05:25.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f5d03cdc640 1 -- start start 2024-04-09T12:05:25.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f5d03cdc640 1 librados: setting wanted keys 2024-04-09T12:05:25.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f5d03cdc640 1 librados: calling monclient init 2024-04-09T12:05:25.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f5d03cdc640 10 monclient: init 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 1 -- 172.21.15.29:0/2780152114 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c011830 con 0x7f0ca413b220 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 10 monclient: dump: 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.352 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.353 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 1 -- 172.21.15.29:0/2780152114 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c0119b0 con 0x7f0ca413b220 2024-04-09T12:05:25.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 1 -- 172.21.15.29:0/2780152114 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c011d60 con 0x7f0ca413b220 2024-04-09T12:05:25.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:25.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0c92ffd640 10 monclient: dump: 2024-04-09T12:05:25.353 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.354 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.354 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.354 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.354 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.354 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.354 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.354 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.355 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.355 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0ca0d99640 4 set_mon_vals no callback set 2024-04-09T12:05:25.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0ca8edc640 5 monclient: authenticate success, global_id 4381 2024-04-09T12:05:25.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0ca8edc640 10 monclient: _renew_subs 2024-04-09T12:05:25.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0ca8edc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0ca8edc640 1 -- 172.21.15.29:0/2780152114 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca4137670 con 0x7f0ca413b220 2024-04-09T12:05:25.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0ca8edc640 10 client.4381.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:25.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0ca8edc640 10 monclient: _renew_subs 2024-04-09T12:05:25.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0ca8edc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0ca8edc640 1 -- 172.21.15.29:0/2780152114 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca413e540 con 0x7f0ca413b220 2024-04-09T12:05:25.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.340+0000 7f0ca8edc640 1 librados: init done 2024-04-09T12:05:25.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-09T12:05:25.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cfc0a8f10 0x7f5cfc140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 10 monclient(hunting): picked mon.noname-a con 0x7f5cfc0a8f10 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:25.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cfc0b7b10 0x7f5cfc141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 10 monclient(hunting): picked mon.noname-b con 0x7f5cfc0b7b10 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:25.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cfc13f1b0 0x7f5cfc139e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 10 monclient(hunting): picked mon.noname-c con 0x7f5cfc13f1b0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc140fe0 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc142210 con 0x7f5cfc0b7b10 2024-04-09T12:05:25.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc1424f0 con 0x7f5cfc13f1b0 2024-04-09T12:05:25.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f5d03cdc640 10 monclient(hunting): authenticate will time out at 1391.461410s 2024-04-09T12:05:25.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f0ca8edc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f0ca8edc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f0ca8edc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.341+0000 7f0ca8edc640 1 -- 172.21.15.29:0/2780152114 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca413c710 con 0x7f0ca413b220 2024-04-09T12:05:25.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae42ffd640 1 -- 172.21.15.29:0/209149643 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48015690 con 0x7fae4c0c64e0 2024-04-09T12:05:25.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae42ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae42ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:25.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae42ffd640 10 monclient: dump: 2024-04-09T12:05:25.359 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.359 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.359 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.360 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae42ffd640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae42ffd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae5359e640 5 monclient: authenticate success, global_id 4384 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae42ffd640 1 -- 172.21.15.29:0/209149643 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae480157f0 con 0x7fae4c0c64e0 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae5359e640 10 monclient: _renew_subs 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae5359e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.342+0000 7fae5359e640 1 -- 172.21.15.29:0/209149643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c008bf0 con 0x7fae4c0c64e0 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.343+0000 7fae42ffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.343+0000 7fae42ffd640 1 -- 172.21.15.29:0/209149643 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48015b80 con 0x7fae4c0c64e0 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.343+0000 7fae42ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.343+0000 7fae42ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.343+0000 7fae42ffd640 10 monclient: dump: 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.343+0000 7fae5359e640 10 client.4384.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.343+0000 7fae5359e640 10 monclient: _renew_subs 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.343+0000 7fae5359e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.343+0000 7fae5359e640 1 -- 172.21.15.29:0/209149643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c007cf0 con 0x7fae4c0c64e0 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.343+0000 7fae5359e640 1 librados: init done 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.343+0000 7fae50d99640 4 set_mon_vals no callback set 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.344+0000 7fae5359e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.344+0000 7fae5359e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.344+0000 7fae5359e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.344+0000 7fae5359e640 1 -- 172.21.15.29:0/209149643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c0056d0 con 0x7fae4c0c64e0 2024-04-09T12:05:25.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.345+0000 7fef7ad9d640 10 monclient(hunting): handle_auth_done global_id 4387 payload 824 2024-04-09T12:05:25.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.345+0000 7fef7ad9d640 1 -- 172.21.15.29:0/2106819537 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef7c0a8f10 msgr2=0x7fef7c0b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.345+0000 7fef7ad9d640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef7c0a8f10 0x7fef7c0b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.345+0000 7fef7ad9d640 1 -- 172.21.15.29:0/2106819537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef7c0b7b10 msgr2=0x7fef7c13fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.345+0000 7fef7ad9d640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef7c0b7b10 0x7fef7c13fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.345+0000 7fef7ad9d640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.345+0000 7fef7ad9d640 1 monclient: found mon.noname-b 2024-04-09T12:05:25.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.345+0000 7fef7ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.345+0000 7fef7ad9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.345+0000 7fef7ad9d640 1 -- 172.21.15.29:0/2106819537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74009b30 con 0x7fef7c13f1b0 2024-04-09T12:05:25.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6ee7fc640 1 -- 172.21.15.29:0/4272161904 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc02e070 con 0x7fe6e8039160 2024-04-09T12:05:25.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6ee7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6ee7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:25.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6ee7fc640 10 monclient: dump: 2024-04-09T12:05:25.367 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.367 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.367 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.367 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6ee7fc640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6ee7fc640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6f49c8640 5 monclient: authenticate success, global_id 4302 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6f49c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6ee7fc640 1 -- 172.21.15.29:0/4272161904 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0315a0 con 0x7fe6e8039160 2024-04-09T12:05:25.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6ee7fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6f49c8640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.346+0000 7fe6f49c8640 4 set_mon_vals no callback set 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6ee7fc640 1 -- 172.21.15.29:0/4272161904 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc02e070 con 0x7fe6e8039160 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6ee7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6ee7fc640 10 monclient: dump: 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.369 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6f49c8640 10 monclient: shutdown 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6f49c8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6f49c8640 1 -- 172.21.15.29:0/4272161904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6e8039160 msgr2=0x7fe6e80c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6f49c8640 1 --2- 172.21.15.29:0/4272161904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6e8039160 0x7fe6e80c8320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0097d0 tx=0x7fe6dc02b840 comp rx=0 tx=0).stop 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6f49c8640 1 -- 172.21.15.29:0/4272161904 shutdown_connections 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6f49c8640 1 --2- 172.21.15.29:0/4272161904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6e8039160 0x7fe6e80c8320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6f49c8640 1 --2- 172.21.15.29:0/4272161904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6e8038d80 0x7fe6e80c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6f49c8640 1 -- 172.21.15.29:0/4272161904 >> 172.21.15.29:0/4272161904 conn(0x7fe6e80065e0 msgr2=0x7fe6e80069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6f49c8640 1 -- 172.21.15.29:0/4272161904 shutdown_connections 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.347+0000 7fe6f49c8640 1 -- 172.21.15.29:0/4272161904 wait complete. 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.348+0000 7fe6f49c8640 10 monclient: build_initial_monmap 2024-04-09T12:05:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.349+0000 7fe6f49c8640 10 monclient: monmap: 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.349+0000 7fe6f49c8640 1 librados: starting msgr at 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.349+0000 7fe6f49c8640 1 librados: starting objecter 2024-04-09T12:05:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.349+0000 7fe6f49c8640 1 Processor -- start 2024-04-09T12:05:25.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.350+0000 7f5d01277640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cfc0b7b10 0x7f5cfc141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.350+0000 7fe6f49c8640 1 -- start start 2024-04-09T12:05:25.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.350+0000 7fe6f49c8640 1 librados: setting wanted keys 2024-04-09T12:05:25.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.350+0000 7fe6f49c8640 1 librados: calling monclient init 2024-04-09T12:05:25.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.350+0000 7fe6f49c8640 10 monclient: init 2024-04-09T12:05:25.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.350+0000 7f5d01a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cfc0a8f10 0x7f5cfc140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:25.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:05:25.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6e8038d80 0x7fe6e80329f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7f5d01a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cfc0a8f10 0x7f5cfc140370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48224/0 (socket says 172.21.15.29:48224) 2024-04-09T12:05:25.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7f5d01a78640 1 -- 172.21.15.29:0/2428863897 learned_addr learned my addr 172.21.15.29:0/2428863897 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7f5d01a78640 10 monclient(hunting): get_auth_request con 0x7f5cfc0a8f10 auth_method 0 2024-04-09T12:05:25.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7f5d01a78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7f5d01a78640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 10 monclient(hunting): picked mon.noname-b con 0x7fe6e8038d80 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7f5d01a78640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6e80c5770 0x7fe6e802fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 10 monclient(hunting): picked mon.noname-c con 0x7fe6e80c5770 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6e80be3c0 0x7fe6e80be940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7f5d01a78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7f5d01a78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 10 monclient(hunting): picked mon.noname-a con 0x7fe6e80be3c0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:25.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7f5d01a78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80cb520 con 0x7fe6e80be3c0 2024-04-09T12:05:25.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80cb800 con 0x7fe6e8038d80 2024-04-09T12:05:25.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:25.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e802f1b0 con 0x7fe6e80c5770 2024-04-09T12:05:25.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:25.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.351+0000 7fe6f49c8640 10 monclient(hunting): authenticate will time out at 1391.471983s 2024-04-09T12:05:25.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.355+0000 7f5d01a78640 10 monclient(hunting): handle_auth_done global_id 4305 payload 824 2024-04-09T12:05:25.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.355+0000 7f5d01a78640 1 -- 172.21.15.29:0/2428863897 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cfc13f1b0 msgr2=0x7f5cfc139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.355+0000 7f5d01a78640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cfc13f1b0 0x7f5cfc139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.355+0000 7f5d01a78640 1 -- 172.21.15.29:0/2428863897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cfc0b7b10 msgr2=0x7f5cfc141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.355+0000 7f5d01a78640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cfc0b7b10 0x7f5cfc141400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.355+0000 7f5d01a78640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.355+0000 7f5d01a78640 1 monclient: found mon.noname-a 2024-04-09T12:05:25.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.355+0000 7f5d01a78640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.355+0000 7f5d01a78640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.355+0000 7f5d01a78640 1 -- 172.21.15.29:0/2428863897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf4009b30 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.359+0000 7f5d01a78640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cfc0a8f10 0x7f5cfc140370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800b4a0 tx=0x7f5cf800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.359+0000 7f5cf27fc640 10 client.?.objecter ms_handle_connect 0x7f5cfc0a8f10 2024-04-09T12:05:25.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.359+0000 7f5cf27fc640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:25.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.366+0000 7fe6effff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6e80be3c0 0x7fe6e80be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 1 -- 172.21.15.29:0/2428863897 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8010610 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 10 monclient: dump: 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.384 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 1 -- 172.21.15.29:0/2428863897 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8010770 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5d03cdc640 5 monclient: authenticate success, global_id 4305 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5d03cdc640 10 monclient: _renew_subs 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5d03cdc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5d03cdc640 1 -- 172.21.15.29:0/2428863897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc1427d0 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 1 -- 172.21.15.29:0/2428863897 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8010b20 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf27fc640 10 monclient: dump: 2024-04-09T12:05:25.385 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5cf3fff640 4 set_mon_vals no callback set 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5d03cdc640 10 client.4305.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5d03cdc640 10 monclient: _renew_subs 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5d03cdc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5d03cdc640 1 -- 172.21.15.29:0/2428863897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc13a540 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7f5d03cdc640 1 librados: init done 2024-04-09T12:05:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7fe6effff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6e80be3c0 0x7fe6e80be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48228/0 (socket says 172.21.15.29:48228) 2024-04-09T12:05:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7fe6effff640 1 -- 172.21.15.29:0/3547706042 learned_addr learned my addr 172.21.15.29:0/3547706042 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7fe6effff640 10 monclient(hunting): get_auth_request con 0x7fe6e80be3c0 auth_method 0 2024-04-09T12:05:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7fe6effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7fe6effff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.367+0000 7fe6effff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:25.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.368+0000 7fe6effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:25.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.368+0000 7f5d03cdc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.368+0000 7fe6effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:25.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.368+0000 7f5d03cdc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.368+0000 7f5d03cdc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.368+0000 7f5d03cdc640 1 -- 172.21.15.29:0/2428863897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cfc04e160 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.368+0000 7fe6effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.370+0000 7fe6effff640 10 monclient(hunting): handle_auth_done global_id 4308 payload 824 2024-04-09T12:05:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.370+0000 7fe6effff640 1 -- 172.21.15.29:0/3547706042 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6e80c5770 msgr2=0x7fe6e802fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.370+0000 7fe6effff640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6e80c5770 0x7fe6e802fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.370+0000 7fe6effff640 1 -- 172.21.15.29:0/3547706042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6e8038d80 msgr2=0x7fe6e80329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.370+0000 7fe6effff640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6e8038d80 0x7fe6e80329f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.370+0000 7fe6effff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.370+0000 7fe6effff640 1 monclient: found mon.noname-a 2024-04-09T12:05:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.370+0000 7fe6effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.370+0000 7fe6effff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.370+0000 7fe6effff640 1 -- 172.21.15.29:0/3547706042 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc009400 con 0x7fe6e80be3c0 2024-04-09T12:05:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.375+0000 7fe6effff640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6e80be3c0 0x7fe6e80be940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6f004fa60 tx=0x7fe6f0067180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.375+0000 7fe6dbfff640 10 client.?.objecter ms_handle_connect 0x7fe6e80be3c0 2024-04-09T12:05:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.375+0000 7fe6dbfff640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.376+0000 7f5611ffb640 1 -- 172.21.15.29:0/1717451794 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f560c058970 con 0x7f561c06db90 2024-04-09T12:05:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.376+0000 7f5611ffb640 10 client.4301.objecter ms_dispatch 0x7f561c000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.376+0000 7f5611ffb640 3 client.4301.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.376+0000 7f5611ffb640 3 client.4301.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:25.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.376+0000 7f5611ffb640 20 client.4301.objecter dump_active .. 0 homeless 2024-04-09T12:05:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.448+0000 7f5611ffb640 1 -- 172.21.15.29:0/1717451794 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f560c0545b0 con 0x7f561c06db90 2024-04-09T12:05:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.448+0000 7f5611ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.448+0000 7f5611ffb640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:25.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.496+0000 7f330bfff640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-09T12:05:25.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.496+0000 7f330bfff640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-09T12:05:25.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.496+0000 7f330bfff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.496+0000 7f330bfff640 1 -- 172.21.15.29:0/561650916 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f330c0b2010 con 0x7f330c1de2a0 2024-04-09T12:05:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.576+0000 7fd239a71640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-09T12:05:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.576+0000 7fd239a71640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-09T12:05:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.576+0000 7fd239a71640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.576+0000 7fd239a71640 1 -- 172.21.15.29:0/4282116622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd2140055c0 con 0x7fd22c0cc600 2024-04-09T12:05:25.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.583+0000 7fef7ad9d640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c13f1b0 0x7fef7c0b6020 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef74036040 tx=0x7fef74004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.584+0000 7fef6affd640 10 client.?.objecter ms_handle_connect 0x7fef7c13f1b0 2024-04-09T12:05:25.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.584+0000 7fef6affd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:25.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.597+0000 7f0c92ffd640 1 -- 172.21.15.29:0/2780152114 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0c9c01a400 con 0x7f0ca413b220 2024-04-09T12:05:25.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.598+0000 7f0c92ffd640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0c8406c5c0 0x7f0c8406ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.598+0000 7f0ca259c640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0c8406c5c0 0x7f0c8406ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.598+0000 7f0ca259c640 10 monclient: get_auth_request con 0x7f0c8406c5c0 auth_method 0 2024-04-09T12:05:25.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.599+0000 7f0ca259c640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0c8406c5c0 0x7f0c8406ea80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c9402be60 tx=0x7f0c94030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.599+0000 7f0c92ffd640 10 client.4381.objecter ms_handle_connect 0x7f0c8406c5c0 2024-04-09T12:05:25.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.601+0000 7f0c92ffd640 1 -- 172.21.15.29:0/2780152114 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0c9c058e20 con 0x7f0ca413b220 2024-04-09T12:05:25.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.601+0000 7f0c92ffd640 10 client.4381.objecter ms_dispatch 0x7f0ca4000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:25.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.601+0000 7f0c92ffd640 3 client.4381.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:25.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.601+0000 7f0c92ffd640 3 client.4381.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:25.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.601+0000 7f0c92ffd640 20 client.4381.objecter dump_active .. 0 homeless 2024-04-09T12:05:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.613+0000 7f0c92ffd640 1 -- 172.21.15.29:0/2780152114 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f0c9c054a60 con 0x7f0ca413b220 2024-04-09T12:05:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.613+0000 7f0c92ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.613+0000 7f0c92ffd640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 1 -- 172.21.15.29:0/2106819537 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74040670 con 0x7fef7c13f1b0 2024-04-09T12:05:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 10 monclient: dump: 2024-04-09T12:05:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.620 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 1 -- 172.21.15.29:0/2106819537 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef740407f0 con 0x7fef7c13f1b0 2024-04-09T12:05:25.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 1 -- 172.21.15.29:0/2106819537 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74040ba0 con 0x7fef7c13f1b0 2024-04-09T12:05:25.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef80e64640 5 monclient: authenticate success, global_id 4387 2024-04-09T12:05:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef80e64640 10 monclient: _renew_subs 2024-04-09T12:05:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef80e64640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef80e64640 1 -- 172.21.15.29:0/2106819537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c0b74d0 con 0x7fef7c13f1b0 2024-04-09T12:05:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef78d99640 4 set_mon_vals no callback set 2024-04-09T12:05:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef80e64640 10 client.4387.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef6affd640 10 monclient: dump: 2024-04-09T12:05:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.623 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.623 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.623 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.623 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef80e64640 10 monclient: _renew_subs 2024-04-09T12:05:25.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef80e64640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef80e64640 1 -- 172.21.15.29:0/2106819537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c0b6740 con 0x7fef7c13f1b0 2024-04-09T12:05:25.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.614+0000 7fef80e64640 1 librados: init done 2024-04-09T12:05:25.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.615+0000 7fef80e64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.615+0000 7fef80e64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.615+0000 7fef80e64640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.615+0000 7fef80e64640 1 -- 172.21.15.29:0/2106819537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c13b0f0 con 0x7fef7c13f1b0 2024-04-09T12:05:25.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.649+0000 7f5cf27fc640 1 -- 172.21.15.29:0/2428863897 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5cf8010c80 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.650+0000 7f5cf27fc640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f5ce006c590 0x7f5ce006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.650+0000 7f5d01277640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f5ce006c590 0x7f5ce006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.650+0000 7f5d01277640 10 monclient: get_auth_request con 0x7f5ce006c590 auth_method 0 2024-04-09T12:05:25.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.650+0000 7f5622304640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-09T12:05:25.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.650+0000 7f5622304640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-09T12:05:25.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.650+0000 7f5622304640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:25.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.650+0000 7f5622304640 1 -- 172.21.15.29:0/1717451794 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f561c145920 con 0x7f561c06db90 2024-04-09T12:05:25.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.650+0000 7f5d01277640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f5ce006c590 0x7f5ce006ea50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0b58d0 tx=0x7f5cec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.651+0000 7f5cf27fc640 10 client.4305.objecter ms_handle_connect 0x7f5ce006c590 2024-04-09T12:05:25.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.658+0000 7f5611ffb640 1 -- 172.21.15.29:0/1717451794 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f560c01e090 con 0x7f561c06db90 2024-04-09T12:05:25.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.659+0000 7f5611ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-09T12:05:25.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.659+0000 7f5611ffb640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:25.662 INFO:teuthology.orchestra.run.smithi029.stdout:64424509445 2024-04-09T12:05:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.660+0000 7f5622304640 10 librados: watch_flush enter 2024-04-09T12:05:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.660+0000 7f5622304640 10 librados: watch_flush exit 2024-04-09T12:05:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.660+0000 7f5622304640 20 client.4301.objecter shutdown clearing up homeless session... 2024-04-09T12:05:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.660+0000 7f5622304640 10 client.4301.objecter successfully canceled tick 2024-04-09T12:05:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 -- 172.21.15.29:0/1717451794 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f560006c5e0 msgr2=0x7f560006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f560006c5e0 0x7f560006eaa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5618001560 tx=0x7f5618007990 comp rx=0 tx=0).stop 2024-04-09T12:05:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 10 monclient: shutdown 2024-04-09T12:05:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 -- 172.21.15.29:0/1717451794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06db90 msgr2=0x7f561c0b1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06db90 0x7f561c0b1d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f560c00b4a0 tx=0x7f560c00b960 comp rx=0 tx=0).stop 2024-04-09T12:05:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 -- 172.21.15.29:0/1717451794 shutdown_connections 2024-04-09T12:05:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f560006c5e0 0x7f560006eaa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f561c06e9a0 0x7f561c145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f561c06db90 0x7f561c0b1d00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 --2- 172.21.15.29:0/1717451794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f561c06d7b0 0x7f561c145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 -- 172.21.15.29:0/1717451794 >> 172.21.15.29:0/1717451794 conn(0x7f561c0b2c80 msgr2=0x7f561c13fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:25.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 -- 172.21.15.29:0/1717451794 shutdown_connections 2024-04-09T12:05:25.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 -- 172.21.15.29:0/1717451794 wait complete. 2024-04-09T12:05:25.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.661+0000 7f5622304640 1 librados: shutdown 2024-04-09T12:05:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.666+0000 7f5cf27fc640 1 -- 172.21.15.29:0/2428863897 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5cf80589a0 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.667+0000 7f5cf27fc640 10 client.4305.objecter ms_dispatch 0x7f5cfc000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.667+0000 7f5cf27fc640 3 client.4305.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.667+0000 7f5cf27fc640 3 client.4305.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.667+0000 7f5cf27fc640 20 client.4305.objecter dump_active .. 0 homeless 2024-04-09T12:05:25.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.667+0000 7f5cf27fc640 1 -- 172.21.15.29:0/2428863897 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f5cf80545e0 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.667+0000 7f5cf27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.667+0000 7f5cf27fc640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:25.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-04-09T12:05:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 1 -- 172.21.15.29:0/3547706042 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f004f050 con 0x7fe6e80be3c0 2024-04-09T12:05:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 10 monclient: dump: 2024-04-09T12:05:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 10 monclient: _finish_auth 0 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 10 monclient: _check_auth_tickets 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 1 -- 172.21.15.29:0/3547706042 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f00695c0 con 0x7fe6e80be3c0 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6f49c8640 5 monclient: authenticate success, global_id 4308 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6f49c8640 10 monclient: _renew_subs 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6f49c8640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6f49c8640 1 -- 172.21.15.29:0/3547706042 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e80bfa20 con 0x7fe6e80be3c0 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 1 -- 172.21.15.29:0/3547706042 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f00723e0 con 0x7fe6e80be3c0 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6dbfff640 10 monclient: dump: 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6edffb640 4 set_mon_vals no callback set 2024-04-09T12:05:25.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6f49c8640 10 client.4308.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:25.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6f49c8640 10 monclient: _renew_subs 2024-04-09T12:05:25.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6f49c8640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6f49c8640 1 -- 172.21.15.29:0/3547706042 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e8030480 con 0x7fe6e80be3c0 2024-04-09T12:05:25.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fe6f49c8640 1 librados: init done 2024-04-09T12:05:25.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fd2317fa640 1 -- 172.21.15.29:0/4282116622 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd220041070 con 0x7fd22c0cc600 2024-04-09T12:05:25.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fd2317fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-09T12:05:25.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.688+0000 7fd2317fa640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:25.696 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2024-04-09T12:05:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.690+0000 7fe6f49c8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.690+0000 7fe6f49c8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.690+0000 7fe6f49c8640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.690+0000 7fe6f49c8640 1 -- 172.21.15.29:0/3547706042 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e8008600 con 0x7fe6e80be3c0 2024-04-09T12:05:25.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 10 librados: watch_flush enter 2024-04-09T12:05:25.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 10 librados: watch_flush exit 2024-04-09T12:05:25.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 20 client.4296.objecter shutdown clearing up homeless session... 2024-04-09T12:05:25.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 10 client.4296.objecter successfully canceled tick 2024-04-09T12:05:25.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 -- 172.21.15.29:0/4282116622 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd21806c5e0 msgr2=0x7fd21806eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd21806c5e0 0x7fd21806eaa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd228001560 tx=0x7fd228007990 comp rx=0 tx=0).stop 2024-04-09T12:05:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 10 monclient: shutdown 2024-04-09T12:05:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 -- 172.21.15.29:0/4282116622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd22c0cc600 msgr2=0x7fd22c02fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd22c0cc600 0x7fd22c02fc00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd22002b8c0 tx=0x7fd2200046c0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 -- 172.21.15.29:0/4282116622 shutdown_connections 2024-04-09T12:05:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd21806c5e0 0x7fd21806eaa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd22c0c8a70 0x7fd22c0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd22c0cc600 0x7fd22c02fc00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 --2- 172.21.15.29:0/4282116622 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd22c038fe0 0x7fd22c02d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 -- 172.21.15.29:0/4282116622 >> 172.21.15.29:0/4282116622 conn(0x7fd22c0065d0 msgr2=0x7fd22c034420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 -- 172.21.15.29:0/4282116622 shutdown_connections 2024-04-09T12:05:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 -- 172.21.15.29:0/4282116622 wait complete. 2024-04-09T12:05:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.691+0000 7fd239a71640 1 librados: shutdown 2024-04-09T12:05:25.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-09T12:05:25.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.804+0000 7f0ca8edc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2024-04-09T12:05:25.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.804+0000 7f0ca8edc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-04-09T12:05:25.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.804+0000 7f0ca8edc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:25.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.804+0000 7f0ca8edc640 1 -- 172.21.15.29:0/2780152114 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0ca4137e20 con 0x7f0ca413b220 2024-04-09T12:05:25.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.853+0000 7f5d03cdc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-09T12:05:25.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.853+0000 7f5d03cdc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-09T12:05:25.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.853+0000 7f5d03cdc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:25.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.853+0000 7f5d03cdc640 1 -- 172.21.15.29:0/2428863897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5cfc0b2ec0 con 0x7f5cfc0a8f10 2024-04-09T12:05:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.963+0000 7fe6dbfff640 1 -- 172.21.15.29:0/3547706042 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe6f00933c0 con 0x7fe6e80be3c0 2024-04-09T12:05:25.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.964+0000 7fe6dbfff640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6d406c590 0x7fe6d406ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:25.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.964+0000 7fe6ef7fe640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6d406c590 0x7fe6d406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:25.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.964+0000 7fe6ef7fe640 10 monclient: get_auth_request con 0x7fe6d406c590 auth_method 0 2024-04-09T12:05:25.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.964+0000 7fe6dbfff640 10 client.4308.objecter ms_handle_connect 0x7fe6d406c590 2024-04-09T12:05:25.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.964+0000 7fe6ef7fe640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6d406c590 0x7fe6d406ea50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009710 tx=0x7fe6e4006c80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:25.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.978+0000 7fe6dbfff640 1 -- 172.21.15.29:0/3547706042 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe6f00d22a0 con 0x7fe6e80be3c0 2024-04-09T12:05:25.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.978+0000 7fe6dbfff640 10 client.4308.objecter ms_dispatch 0x7fe6f0000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:25.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.978+0000 7fe6dbfff640 3 client.4308.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:25.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.978+0000 7fe6dbfff640 3 client.4308.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.978+0000 7fe6dbfff640 20 client.4308.objecter dump_active .. 0 homeless 2024-04-09T12:05:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.978+0000 7fe6dbfff640 1 -- 172.21.15.29:0/3547706042 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fe6f00cdee0 con 0x7fe6e80be3c0 2024-04-09T12:05:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.978+0000 7fe6dbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:25.978+0000 7fe6dbfff640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:26.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.017+0000 7f5cf27fc640 1 -- 172.21.15.29:0/2428863897 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5cf801e020 con 0x7f5cfc0a8f10 2024-04-09T12:05:26.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.017+0000 7f5cf27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-09T12:05:26.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.017+0000 7f5cf27fc640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:26.021 INFO:teuthology.orchestra.run.smithi029.stdout:90194313223 2024-04-09T12:05:26.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.019+0000 7f5d03cdc640 10 librados: watch_flush enter 2024-04-09T12:05:26.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.019+0000 7f5d03cdc640 10 librados: watch_flush exit 2024-04-09T12:05:26.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.019+0000 7f5d03cdc640 20 client.4305.objecter shutdown clearing up homeless session... 2024-04-09T12:05:26.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.019+0000 7f5d03cdc640 10 client.4305.objecter successfully canceled tick 2024-04-09T12:05:26.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 -- 172.21.15.29:0/2428863897 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f5ce006c590 msgr2=0x7f5ce006ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f5ce006c590 0x7f5ce006ea50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0b58d0 tx=0x7f5cec009040 comp rx=0 tx=0).stop 2024-04-09T12:05:26.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 10 monclient: shutdown 2024-04-09T12:05:26.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:26.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 -- 172.21.15.29:0/2428863897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cfc0a8f10 msgr2=0x7f5cfc140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cfc0a8f10 0x7f5cfc140370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800b4a0 tx=0x7f5cf800b960 comp rx=0 tx=0).stop 2024-04-09T12:05:26.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 -- 172.21.15.29:0/2428863897 shutdown_connections 2024-04-09T12:05:26.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f5ce006c590 0x7f5ce006ea50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cfc13f1b0 0x7f5cfc139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cfc0b7b10 0x7f5cfc141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 --2- 172.21.15.29:0/2428863897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cfc0a8f10 0x7f5cfc140370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 -- 172.21.15.29:0/2428863897 >> 172.21.15.29:0/2428863897 conn(0x7f5cfc066140 msgr2=0x7f5cfc068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:26.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 -- 172.21.15.29:0/2428863897 shutdown_connections 2024-04-09T12:05:26.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 -- 172.21.15.29:0/2428863897 wait complete. 2024-04-09T12:05:26.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.020+0000 7f5d03cdc640 1 librados: shutdown 2024-04-09T12:05:26.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313224 got 90194313223 for osd.1 2024-04-09T12:05:26.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.100+0000 7fae42ffd640 1 -- 172.21.15.29:0/209149643 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae48015ce0 con 0x7fae4c0c64e0 2024-04-09T12:05:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.100+0000 7fae42ffd640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fae3406c610 0x7fae3406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.101+0000 7fae5259c640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fae3406c610 0x7fae3406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.101+0000 7fae5259c640 10 monclient: get_auth_request con 0x7fae3406c610 auth_method 0 2024-04-09T12:05:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.101+0000 7fae42ffd640 10 client.4384.objecter ms_handle_connect 0x7fae3406c610 2024-04-09T12:05:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.101+0000 7fae5259c640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fae3406c610 0x7fae3406ead0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fae44007fd0 tx=0x7fae440079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.103+0000 7fae42ffd640 1 -- 172.21.15.29:0/209149643 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fae480273e0 con 0x7fae4c0c64e0 2024-04-09T12:05:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.103+0000 7fae42ffd640 10 client.4384.objecter ms_dispatch 0x7fae54000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.103+0000 7fae42ffd640 3 client.4384.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.103+0000 7fae42ffd640 3 client.4384.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.103+0000 7fae42ffd640 20 client.4384.objecter dump_active .. 0 homeless 2024-04-09T12:05:26.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.113+0000 7fae42ffd640 1 -- 172.21.15.29:0/209149643 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fae48055380 con 0x7fae4c0c64e0 2024-04-09T12:05:26.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.113+0000 7fae42ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:26.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.113+0000 7fae42ffd640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:26.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.142+0000 7fef6affd640 1 -- 172.21.15.29:0/2106819537 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef74040d00 con 0x7fef7c13f1b0 2024-04-09T12:05:26.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.142+0000 7fef6affd640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fef5c06c5e0 0x7fef5c06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.143+0000 7fef7a59c640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fef5c06c5e0 0x7fef5c06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:26.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.143+0000 7fef7a59c640 10 monclient: get_auth_request con 0x7fef5c06c5e0 auth_method 0 2024-04-09T12:05:26.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.143+0000 7fef7a59c640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fef5c06c5e0 0x7fef5c06eaa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009710 tx=0x7fef6c006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:26.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.143+0000 7fef6affd640 10 client.4387.objecter ms_handle_connect 0x7fef5c06c5e0 2024-04-09T12:05:26.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.148+0000 7fef6affd640 1 -- 172.21.15.29:0/2106819537 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fef7407c240 con 0x7fef7c13f1b0 2024-04-09T12:05:26.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.148+0000 7fef6affd640 10 client.4387.objecter ms_dispatch 0x7fef7c000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:26.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.148+0000 7fef6affd640 3 client.4387.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:26.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.148+0000 7fef6affd640 3 client.4387.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:26.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.148+0000 7fef6affd640 20 client.4387.objecter dump_active .. 0 homeless 2024-04-09T12:05:26.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.158+0000 7fef6affd640 1 -- 172.21.15.29:0/2106819537 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fef74077e80 con 0x7fef7c13f1b0 2024-04-09T12:05:26.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.159+0000 7fef6affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:26.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.159+0000 7fef6affd640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:26.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.160+0000 7f32f37fe640 1 -- 172.21.15.29:0/561650916 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f32fc014020 con 0x7f330c1de2a0 2024-04-09T12:05:26.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.160+0000 7f32f37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-09T12:05:26.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.160+0000 7f32f37fe640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:26.163 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2024-04-09T12:05:26.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.161+0000 7f330bfff640 10 librados: watch_flush enter 2024-04-09T12:05:26.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.161+0000 7f330bfff640 10 librados: watch_flush exit 2024-04-09T12:05:26.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.161+0000 7f330bfff640 20 client.4369.objecter shutdown clearing up homeless session... 2024-04-09T12:05:26.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.161+0000 7f330bfff640 10 client.4369.objecter successfully canceled tick 2024-04-09T12:05:26.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 -- 172.21.15.29:0/561650916 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f32f806c5e0 msgr2=0x7f32f806eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f32f806c5e0 0x7f32f806eaa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3300036000 tx=0x7f3300030000 comp rx=0 tx=0).stop 2024-04-09T12:05:26.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 10 monclient: shutdown 2024-04-09T12:05:26.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:26.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 -- 172.21.15.29:0/561650916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f330c1de2a0 msgr2=0x7f330c1de700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f330c1de2a0 0x7f330c1de700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00b4b0 tx=0x7f32fc00b970 comp rx=0 tx=0).stop 2024-04-09T12:05:26.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 -- 172.21.15.29:0/561650916 shutdown_connections 2024-04-09T12:05:26.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f32f806c5e0 0x7f32f806eaa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f330c1daaa0 0x7f330c1daf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f330c1de2a0 0x7f330c1de700 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 --2- 172.21.15.29:0/561650916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f330c0b3770 0x7f330c12a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 -- 172.21.15.29:0/561650916 >> 172.21.15.29:0/561650916 conn(0x7f330c0b2c80 msgr2=0x7f330c0afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:26.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 -- 172.21.15.29:0/561650916 shutdown_connections 2024-04-09T12:05:26.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 -- 172.21.15.29:0/561650916 wait complete. 2024-04-09T12:05:26.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.162+0000 7f330bfff640 1 librados: shutdown 2024-04-09T12:05:26.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.172+0000 7fe6f49c8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-09T12:05:26.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.172+0000 7fe6f49c8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-09T12:05:26.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.172+0000 7fe6f49c8640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:26.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.172+0000 7fe6f49c8640 1 -- 172.21.15.29:0/3547706042 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe6e80056e0 con 0x7fe6e80be3c0 2024-04-09T12:05:26.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-09T12:05:26.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.176+0000 7f0c92ffd640 1 -- 172.21.15.29:0/2780152114 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c9c015020 con 0x7f0ca413b220 2024-04-09T12:05:26.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.176+0000 7f0c92ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-04-09T12:05:26.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.176+0000 7f0c92ffd640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:26.180 INFO:teuthology.orchestra.run.smithi029.stdout:81604378632 2024-04-09T12:05:26.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 10 librados: watch_flush enter 2024-04-09T12:05:26.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 10 librados: watch_flush exit 2024-04-09T12:05:26.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 20 client.4381.objecter shutdown clearing up homeless session... 2024-04-09T12:05:26.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 10 client.4381.objecter successfully canceled tick 2024-04-09T12:05:26.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 1 -- 172.21.15.29:0/2780152114 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0c8406c5c0 msgr2=0x7f0c8406ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0c8406c5c0 0x7f0c8406ea80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c9402be60 tx=0x7f0c94030000 comp rx=0 tx=0).stop 2024-04-09T12:05:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 10 monclient: shutdown 2024-04-09T12:05:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 1 -- 172.21.15.29:0/2780152114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca413b220 msgr2=0x7f0ca4137010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca413b220 0x7f0ca4137010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00b410 tx=0x7f0c9c00b8d0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 1 -- 172.21.15.29:0/2780152114 shutdown_connections 2024-04-09T12:05:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0c8406c5c0 0x7f0c8406ea80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca413b220 0x7f0ca4137010 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca40ae710 0x7f0ca4136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 1 --2- 172.21.15.29:0/2780152114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca40711e0 0x7f0ca413e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.179+0000 7f0ca8edc640 1 -- 172.21.15.29:0/2780152114 >> 172.21.15.29:0/2780152114 conn(0x7f0ca40b3210 msgr2=0x7f0ca4068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.180+0000 7f0ca8edc640 1 -- 172.21.15.29:0/2780152114 shutdown_connections 2024-04-09T12:05:26.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.180+0000 7f0ca8edc640 1 -- 172.21.15.29:0/2780152114 wait complete. 2024-04-09T12:05:26.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.180+0000 7f0ca8edc640 1 librados: shutdown 2024-04-09T12:05:26.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 81604378633 got 81604378632 for osd.7 2024-04-09T12:05:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.200+0000 7fe6dbfff640 1 -- 172.21.15.29:0/3547706042 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe6f008e070 con 0x7fe6e80be3c0 2024-04-09T12:05:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.200+0000 7fe6dbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-09T12:05:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.200+0000 7fe6dbfff640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:26.203 INFO:teuthology.orchestra.run.smithi029.stdout:64424509446 2024-04-09T12:05:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.202+0000 7fe6f49c8640 10 librados: watch_flush enter 2024-04-09T12:05:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.202+0000 7fe6f49c8640 10 librados: watch_flush exit 2024-04-09T12:05:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.202+0000 7fe6f49c8640 20 client.4308.objecter shutdown clearing up homeless session... 2024-04-09T12:05:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.202+0000 7fe6f49c8640 10 client.4308.objecter successfully canceled tick 2024-04-09T12:05:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 -- 172.21.15.29:0/3547706042 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6d406c590 msgr2=0x7fe6d406ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6d406c590 0x7fe6d406ea50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009710 tx=0x7fe6e4006c80 comp rx=0 tx=0).stop 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 10 monclient: shutdown 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 -- 172.21.15.29:0/3547706042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6e80be3c0 msgr2=0x7fe6e80be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6e80be3c0 0x7fe6e80be940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6f004fa60 tx=0x7fe6f0067180 comp rx=0 tx=0).stop 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 -- 172.21.15.29:0/3547706042 shutdown_connections 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6d406c590 0x7fe6d406ea50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6e80be3c0 0x7fe6e80be940 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6e80c5770 0x7fe6e802fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 --2- 172.21.15.29:0/3547706042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6e8038d80 0x7fe6e80329f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 -- 172.21.15.29:0/3547706042 >> 172.21.15.29:0/3547706042 conn(0x7fe6e80065e0 msgr2=0x7fe6e80069c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 -- 172.21.15.29:0/3547706042 shutdown_connections 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 -- 172.21.15.29:0/3547706042 wait complete. 2024-04-09T12:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.203+0000 7fe6f49c8640 1 librados: shutdown 2024-04-09T12:05:26.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-04-09T12:05:26.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.314+0000 7fae5359e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-09T12:05:26.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.314+0000 7fae5359e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-09T12:05:26.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.314+0000 7fae5359e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:26.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.314+0000 7fae5359e640 1 -- 172.21.15.29:0/209149643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fae4c00add0 con 0x7fae4c0c64e0 2024-04-09T12:05:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.317+0000 7fae42ffd640 1 -- 172.21.15.29:0/209149643 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae480589a0 con 0x7fae4c0c64e0 2024-04-09T12:05:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.317+0000 7fae42ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-09T12:05:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.317+0000 7fae42ffd640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:26.320 INFO:teuthology.orchestra.run.smithi029.stdout:60129542148 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 10 librados: watch_flush enter 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 10 librados: watch_flush exit 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 20 client.4384.objecter shutdown clearing up homeless session... 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 10 client.4384.objecter successfully canceled tick 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 -- 172.21.15.29:0/209149643 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fae3406c610 msgr2=0x7fae3406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fae3406c610 0x7fae3406ead0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fae44007fd0 tx=0x7fae440079e0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 10 monclient: shutdown 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 -- 172.21.15.29:0/209149643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4c0c64e0 msgr2=0x7fae4c0097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4c0c64e0 0x7fae4c0097a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fae4800e5a0 tx=0x7fae4800ea60 comp rx=0 tx=0).stop 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 -- 172.21.15.29:0/209149643 shutdown_connections 2024-04-09T12:05:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fae3406c610 0x7fae3406ead0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4c0c3780 0x7fae4c0c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4c0c64e0 0x7fae4c0097a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 --2- 172.21.15.29:0/209149643 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae3c005180 0x7fae4c0c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 -- 172.21.15.29:0/209149643 >> 172.21.15.29:0/209149643 conn(0x7fae4c006390 msgr2=0x7fae4c0c1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:26.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 -- 172.21.15.29:0/209149643 shutdown_connections 2024-04-09T12:05:26.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 -- 172.21.15.29:0/209149643 wait complete. 2024-04-09T12:05:26.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.319+0000 7fae5359e640 1 librados: shutdown 2024-04-09T12:05:26.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.0 2024-04-09T12:05:26.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.371+0000 7fef80e64640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-09T12:05:26.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.371+0000 7fef80e64640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-09T12:05:26.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.371+0000 7fef80e64640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:26.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.371+0000 7fef80e64640 1 -- 172.21.15.29:0/2106819537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fef7c04e160 con 0x7fef7c13f1b0 2024-04-09T12:05:26.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.376+0000 7fef6affd640 1 -- 172.21.15.29:0/2106819537 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef74044090 con 0x7fef7c13f1b0 2024-04-09T12:05:26.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.376+0000 7fef6affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-09T12:05:26.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.376+0000 7fef6affd640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:26.379 INFO:teuthology.orchestra.run.smithi029.stdout:85899345928 2024-04-09T12:05:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 10 librados: watch_flush enter 2024-04-09T12:05:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 10 librados: watch_flush exit 2024-04-09T12:05:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 20 client.4387.objecter shutdown clearing up homeless session... 2024-04-09T12:05:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 10 client.4387.objecter successfully canceled tick 2024-04-09T12:05:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 -- 172.21.15.29:0/2106819537 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fef5c06c5e0 msgr2=0x7fef5c06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fef5c06c5e0 0x7fef5c06eaa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009710 tx=0x7fef6c006c90 comp rx=0 tx=0).stop 2024-04-09T12:05:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 10 monclient: shutdown 2024-04-09T12:05:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 -- 172.21.15.29:0/2106819537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c13f1b0 msgr2=0x7fef7c0b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c13f1b0 0x7fef7c0b6020 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef74036040 tx=0x7fef74004a40 comp rx=0 tx=0).stop 2024-04-09T12:05:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 -- 172.21.15.29:0/2106819537 shutdown_connections 2024-04-09T12:05:26.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fef5c06c5e0 0x7fef5c06eaa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c13f1b0 0x7fef7c0b6020 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef7c0b7b10 0x7fef7c13fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 --2- 172.21.15.29:0/2106819537 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef7c0a8f10 0x7fef7c0b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 -- 172.21.15.29:0/2106819537 >> 172.21.15.29:0/2106819537 conn(0x7fef7c066140 msgr2=0x7fef7c1440c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:26.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 -- 172.21.15.29:0/2106819537 shutdown_connections 2024-04-09T12:05:26.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 -- 172.21.15.29:0/2106819537 wait complete. 2024-04-09T12:05:26.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.378+0000 7fef80e64640 1 librados: shutdown 2024-04-09T12:05:26.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 85899345930 got 85899345928 for osd.4 2024-04-09T12:05:26.680 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-09T12:05:26.707 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-09T12:05:26.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.780+0000 7f09f8a86640 10 monclient: get_monmap_and_config 2024-04-09T12:05:26.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.780+0000 7f09f8a86640 10 monclient: build_initial_monmap 2024-04-09T12:05:26.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.780+0000 7f09f8a86640 10 monclient: monmap: 2024-04-09T12:05:26.783 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:26.783 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:26.784 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:26.782204+0000 2024-04-09T12:05:26.784 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:26.782204+0000 2024-04-09T12:05:26.784 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:26.784 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.784 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:26.784 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:26.784 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:26.784 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:26.784 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:26.784 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.781+0000 7f09f8a86640 1 Processor -- start 2024-04-09T12:05:26.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.781+0000 7f09f8a86640 1 -- start start 2024-04-09T12:05:26.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.781+0000 7f09f8a86640 10 monclient: init 2024-04-09T12:05:26.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:26.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 10 monclient: _add_conns ranks=[4,3,2,1,0] 2024-04-09T12:05:26.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f09f40b7b10 0x7f09f40a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 10 monclient(hunting): picked mon.noname-c con 0x7f09f40b7b10 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:26.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09f40a8f10 0x7f09f413eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 10 monclient(hunting): picked mon.noname-a con 0x7f09f40a8f10 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:26.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09f413efe0 0x7f09f4144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 10 monclient(hunting): picked mon.noname-b con 0x7f09f413efe0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f413f490 con 0x7f09f40a8f10 2024-04-09T12:05:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f40b7ef0 con 0x7f09f40b7b10 2024-04-09T12:05:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40aa840 con 0x7f09f413efe0 2024-04-09T12:05:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f8a86640 10 monclient(hunting): authenticate will time out at 1392.902158s 2024-04-09T12:05:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f259c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f09f40b7b10 0x7f09f40a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09ebfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09f40a8f10 0x7f09f413eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.782+0000 7f09f2d9d640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09f413efe0 0x7f09f4144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f259c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f09f40b7b10 0x7f09f40a89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:46662/0 (socket says 172.21.15.29:46662) 2024-04-09T12:05:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f259c640 1 -- 172.21.15.29:0/3879207700 learned_addr learned my addr 172.21.15.29:0/3879207700 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f259c640 10 monclient(hunting): get_auth_request con 0x7f09f40b7b10 auth_method 0 2024-04-09T12:05:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f259c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f259c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09ebfff640 10 monclient(hunting): get_auth_request con 0x7f09f40a8f10 auth_method 0 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09ebfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f2d9d640 10 monclient(hunting): get_auth_request con 0x7f09f413efe0 auth_method 0 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f2d9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.783+0000 7f09f259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.784+0000 7f09ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.784+0000 7f09ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.784+0000 7f09ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.784+0000 7f09f2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.784+0000 7f09f2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.784+0000 7f09f2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.785+0000 7f09f259c640 10 monclient(hunting): handle_auth_done global_id 4390 payload 274 2024-04-09T12:05:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.785+0000 7f09f259c640 1 -- 172.21.15.29:0/3879207700 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09f413efe0 msgr2=0x7f09f4144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.785+0000 7f09f259c640 1 --2- 172.21.15.29:0/3879207700 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09f413efe0 0x7f09f4144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.785+0000 7f09f259c640 1 -- 172.21.15.29:0/3879207700 >> v2:172.21.15.29:3300/0 conn(0x7f09f40a8f10 msgr2=0x7f09f413eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.785+0000 7f09f259c640 1 --2- 172.21.15.29:0/3879207700 >> v2:172.21.15.29:3300/0 conn(0x7f09f40a8f10 0x7f09f413eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.785+0000 7f09f259c640 10 monclient: _finish_hunting 0 2024-04-09T12:05:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.785+0000 7f09f259c640 1 monclient: found mon.noname-c 2024-04-09T12:05:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.785+0000 7f09f259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.785+0000 7f09f259c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:05:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.785+0000 7f09f259c640 1 -- 172.21.15.29:0/3879207700 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40a93c0 con 0x7f09f40b7b10 2024-04-09T12:05:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.787+0000 7f09f259c640 1 --2- 172.21.15.29:0/3879207700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09f40b7b10 0x7f09f40a89d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f09f4066af0 tx=0x7f09e402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cf1eea88b119253 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 1 -- 172.21.15.29:0/3879207700 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4031870 con 0x7f09f40b7b10 2024-04-09T12:05:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 10 monclient: dump: 2024-04-09T12:05:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 10 monclient: _finish_auth 0 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 10 monclient: _check_auth_tickets 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 1 -- 172.21.15.29:0/3879207700 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e40319d0 con 0x7f09f40b7b10 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 1 -- 172.21.15.29:0/3879207700 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4031d60 con 0x7f09f40b7b10 2024-04-09T12:05:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f1d9b640 10 monclient: dump: 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f8a86640 5 monclient: authenticate success, global_id 4390 2024-04-09T12:05:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f8a86640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:26.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.790+0000 7f09f8a86640 4 set_mon_vals no callback set 2024-04-09T12:05:26.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.791+0000 7f09f8a86640 10 monclient: shutdown 2024-04-09T12:05:26.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.791+0000 7f09f8a86640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:26.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.791+0000 7f09f8a86640 1 -- 172.21.15.29:0/3879207700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09f40b7b10 msgr2=0x7f09f40a89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.791+0000 7f09f8a86640 1 --2- 172.21.15.29:0/3879207700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09f40b7b10 0x7f09f40a89d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f09f4066af0 tx=0x7f09e402b910 comp rx=0 tx=0).stop 2024-04-09T12:05:26.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.791+0000 7f09f8a86640 1 -- 172.21.15.29:0/3879207700 shutdown_connections 2024-04-09T12:05:26.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.791+0000 7f09f8a86640 1 --2- 172.21.15.29:0/3879207700 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09f413efe0 0x7f09f4144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.791+0000 7f09f8a86640 1 --2- 172.21.15.29:0/3879207700 >> v2:172.21.15.29:3300/0 conn(0x7f09f40a8f10 0x7f09f413eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.791+0000 7f09f8a86640 1 --2- 172.21.15.29:0/3879207700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09f40b7b10 0x7f09f40a89d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.791+0000 7f09f8a86640 1 -- 172.21.15.29:0/3879207700 >> 172.21.15.29:0/3879207700 conn(0x7f09f4066140 msgr2=0x7f09f40b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.791+0000 7f09f8a86640 1 -- 172.21.15.29:0/3879207700 shutdown_connections 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.791+0000 7f09f8a86640 1 -- 172.21.15.29:0/3879207700 wait complete. 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.792+0000 7f09f8a86640 10 monclient: build_initial_monmap 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.792+0000 7f09f8a86640 10 monclient: monmap: 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:26.800 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.792+0000 7f09f8a86640 1 librados: starting msgr at 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.792+0000 7f09f8a86640 1 librados: starting objecter 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.792+0000 7f09f8a86640 1 Processor -- start 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.792+0000 7f09f8a86640 1 -- start start 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.792+0000 7f09f8a86640 1 librados: setting wanted keys 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.792+0000 7f09f8a86640 1 librados: calling monclient init 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.792+0000 7f09f8a86640 10 monclient: init 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09f40a8f10 0x7f09f40adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 10 monclient(hunting): picked mon.noname-b con 0x7f09f40a8f10 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09f40b7b10 0x7f09f40ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 10 monclient(hunting): picked mon.noname-c con 0x7f09f40b7b10 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09f413efe0 0x7f09f413a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 10 monclient(hunting): picked mon.noname-a con 0x7f09f413efe0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40ae530 con 0x7f09f413efe0 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40ae7a0 con 0x7f09f40a8f10 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40afbf0 con 0x7f09f40b7b10 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f8a86640 10 monclient(hunting): authenticate will time out at 1392.913138s 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09f2d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09f413efe0 0x7f09f413a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.793+0000 7f09ebfff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09f40b7b10 0x7f09f40ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09f40a8f10 0x7f09f40adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f2d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09f413efe0 0x7f09f413a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54266/0 (socket says 172.21.15.29:54266) 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f2d9d640 1 -- 172.21.15.29:0/4193369700 learned_addr learned my addr 172.21.15.29:0/4193369700 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f2d9d640 10 monclient(hunting): get_auth_request con 0x7f09f413efe0 auth_method 0 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f2d9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f259c640 10 monclient(hunting): get_auth_request con 0x7f09f40a8f10 auth_method 0 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f259c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f259c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09ebfff640 10 monclient(hunting): get_auth_request con 0x7f09f40b7b10 auth_method 0 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09ebfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:26.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:26.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:26.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:26.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.794+0000 7f09f259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:26.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.795+0000 7f09ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:26.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.795+0000 7f09ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:26.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.795+0000 7f09ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.797+0000 7f09f259c640 10 monclient(hunting): handle_auth_done global_id 4393 payload 824 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.797+0000 7f09f259c640 1 -- 172.21.15.29:0/4193369700 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09f40b7b10 msgr2=0x7f09f40ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.797+0000 7f09f259c640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09f40b7b10 0x7f09f40ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.797+0000 7f09f259c640 1 -- 172.21.15.29:0/4193369700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09f413efe0 msgr2=0x7f09f413a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.797+0000 7f09f259c640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09f413efe0 0x7f09f413a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.797+0000 7f09f259c640 10 monclient: _finish_hunting 0 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.797+0000 7f09f259c640 1 monclient: found mon.noname-b 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.797+0000 7f09f259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.797+0000 7f09f259c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.797+0000 7f09f259c640 1 -- 172.21.15.29:0/4193369700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40094d0 con 0x7f09f40a8f10 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.799+0000 7f09f259c640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09f40a8f10 0x7f09f40adff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f09f40b8130 tx=0x7f09e40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:26.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.799+0000 7f09eaffd640 10 client.?.objecter ms_handle_connect 0x7f09f40a8f10 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.799+0000 7f09eaffd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.802+0000 7f09eaffd640 1 -- 172.21.15.29:0/4193369700 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e403ac60 con 0x7f09f40a8f10 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.802+0000 7f09eaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.802+0000 7f09eaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.802+0000 7f09eaffd640 10 monclient: dump: 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:26.807 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.802+0000 7f09eaffd640 10 monclient: _finish_auth 0 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.802+0000 7f09eaffd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.802+0000 7f09eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09eaffd640 1 -- 172.21.15.29:0/4193369700 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e403ade0 con 0x7f09f40a8f10 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09eaffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09eaffd640 1 -- 172.21.15.29:0/4193369700 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4044630 con 0x7f09f40a8f10 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 5 monclient: authenticate success, global_id 4393 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 10 monclient: _renew_subs 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 1 -- 172.21.15.29:0/4193369700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f40ad8b0 con 0x7f09f40a8f10 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f0d99640 4 set_mon_vals no callback set 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09eaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09eaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09eaffd640 10 monclient: dump: 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 10 client.4393.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 10 monclient: _renew_subs 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:26.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 1 -- 172.21.15.29:0/4193369700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f413a7b0 con 0x7f09f40a8f10 2024-04-09T12:05:26.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 1 librados: init done 2024-04-09T12:05:26.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:26.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:26.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:26.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.803+0000 7f09f8a86640 1 -- 172.21.15.29:0/4193369700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f404e160 con 0x7f09f40a8f10 2024-04-09T12:05:26.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.826+0000 7fed56cdc640 10 monclient: get_monmap_and_config 2024-04-09T12:05:26.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.826+0000 7fed56cdc640 10 monclient: build_initial_monmap 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.826+0000 7fed56cdc640 10 monclient: monmap: 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:26.828337+0000 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:26.828337+0000 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:26.830 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.827+0000 7fed56cdc640 1 Processor -- start 2024-04-09T12:05:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.827+0000 7fed56cdc640 1 -- start start 2024-04-09T12:05:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.827+0000 7fed56cdc640 10 monclient: init 2024-04-09T12:05:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2024-04-09T12:05:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed500b43d0 0x7fed500a8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 10 monclient(hunting): picked mon.noname-b con 0x7fed500b43d0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fed5013e970 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fed50144c50 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed500aa750 con 0x7fed50144c50 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed500a9060 con 0x7fed5013e970 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed500a8e80 con 0x7fed500b43d0 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed56cdc640 10 monclient(hunting): authenticate will time out at 1392.948236s 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.828+0000 7fed54a78640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed500b43d0 0x7fed500a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.829+0000 7fed55279640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fed50144c50 0x7fed501450e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33070/0 (socket says 172.21.15.29:33070) 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.829+0000 7fed55279640 1 -- 172.21.15.29:0/405630109 learned_addr learned my addr 172.21.15.29:0/405630109 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.829+0000 7fed54a78640 10 monclient(hunting): get_auth_request con 0x7fed500b43d0 auth_method 0 2024-04-09T12:05:26.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.829+0000 7fed54a78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:26.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.829+0000 7fed54a78640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:26.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.829+0000 7fed54a78640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:26.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.829+0000 7fed54a78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:26.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.829+0000 7fed54a78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:26.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.829+0000 7fed54a78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:26.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.831+0000 7fed54a78640 10 monclient(hunting): handle_auth_done global_id 4313 payload 274 2024-04-09T12:05:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.831+0000 7fed54a78640 1 -- 172.21.15.29:0/405630109 >> v1:172.21.15.173:6789/0 conn(0x7fed5013e970 legacy=0x7fed5013edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.831+0000 7fed54a78640 1 -- 172.21.15.29:0/405630109 >> v1:172.21.15.29:6789/0 conn(0x7fed50144c50 legacy=0x7fed501450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.831+0000 7fed54a78640 10 monclient: _finish_hunting 0 2024-04-09T12:05:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.831+0000 7fed54a78640 1 monclient: found mon.noname-b 2024-04-09T12:05:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.831+0000 7fed54a78640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.831+0000 7fed54a78640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.831+0000 7fed54a78640 1 -- 172.21.15.29:0/405630109 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed500a9580 con 0x7fed500b43d0 2024-04-09T12:05:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.833+0000 7fed54a78640 1 --2- 172.21.15.29:0/405630109 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed500b43d0 0x7fed500a8940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fed380097d0 tx=0x7fed3802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9527c3587677259f server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 1 -- 172.21.15.29:0/405630109 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38031800 con 0x7fed500b43d0 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 10 monclient: dump: 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 10 monclient: _finish_auth 0 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 10 monclient: _check_auth_tickets 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 1 -- 172.21.15.29:0/405630109 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38031960 con 0x7fed500b43d0 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 5 monclient: authenticate success, global_id 4313 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 4 set_mon_vals no callback set 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 1 -- 172.21.15.29:0/405630109 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38031cf0 con 0x7fed500b43d0 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed4f7fe640 10 monclient: dump: 2024-04-09T12:05:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:26.842 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 10 monclient: shutdown 2024-04-09T12:05:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 1 -- 172.21.15.29:0/405630109 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed500b43d0 msgr2=0x7fed500a8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 1 --2- 172.21.15.29:0/405630109 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed500b43d0 0x7fed500a8940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fed380097d0 tx=0x7fed3802b8a0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 1 -- 172.21.15.29:0/405630109 shutdown_connections 2024-04-09T12:05:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 1 --2- 172.21.15.29:0/405630109 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed500b43d0 0x7fed500a8940 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 1 -- 172.21.15.29:0/405630109 >> 172.21.15.29:0/405630109 conn(0x7fed50065f30 msgr2=0x7fed50066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 1 -- 172.21.15.29:0/405630109 shutdown_connections 2024-04-09T12:05:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.837+0000 7fed56cdc640 1 -- 172.21.15.29:0/405630109 wait complete. 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.838+0000 7fed56cdc640 10 monclient: build_initial_monmap 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.838+0000 7fed56cdc640 10 monclient: monmap: 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.838+0000 7fed56cdc640 1 librados: starting msgr at 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.838+0000 7fed56cdc640 1 librados: starting objecter 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 1 Processor -- start 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 1 -- start start 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 1 librados: setting wanted keys 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 1 librados: calling monclient init 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 10 monclient: init 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed500b43d0 0x7fed50133b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 10 monclient(hunting): picked mon.noname-b con 0x7fed500b43d0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed5013e970 0x7fed500b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 10 monclient(hunting): picked mon.noname-a con 0x7fed5013e970 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed50144c50 0x7fed500b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 10 monclient(hunting): picked mon.noname-c con 0x7fed50144c50 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:26.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed50131470 con 0x7fed5013e970 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed500b6da0 con 0x7fed500b43d0 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed500b4d80 con 0x7fed50144c50 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.839+0000 7fed56cdc640 10 monclient(hunting): authenticate will time out at 1392.959826s 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed55279640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed50144c50 0x7fed500b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed4ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed5013e970 0x7fed500b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed55279640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed50144c50 0x7fed500b74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:56102/0 (socket says 172.21.15.29:56102) 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed55279640 1 -- 172.21.15.29:0/3060002798 learned_addr learned my addr 172.21.15.29:0/3060002798 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed55279640 10 monclient(hunting): get_auth_request con 0x7fed50144c50 auth_method 0 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed55279640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:26.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed55279640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:26.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed55279640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:26.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed4ffff640 10 monclient(hunting): get_auth_request con 0x7fed5013e970 auth_method 0 2024-04-09T12:05:26.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:26.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed4ffff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:26.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.840+0000 7fed4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:26.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.841+0000 7fed55279640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:26.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.841+0000 7fed55279640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:26.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.841+0000 7fed55279640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:26.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.841+0000 7fed4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:26.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.841+0000 7fed4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:26.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.841+0000 7fed4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:26.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.844+0000 7fed55279640 10 monclient(hunting): handle_auth_done global_id 4316 payload 824 2024-04-09T12:05:26.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.844+0000 7fed55279640 1 -- 172.21.15.29:0/3060002798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed500b43d0 msgr2=0x7fed50133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.844+0000 7fed55279640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed500b43d0 0x7fed50133b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.844+0000 7fed55279640 1 -- 172.21.15.29:0/3060002798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed5013e970 msgr2=0x7fed500b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:26.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.844+0000 7fed55279640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed5013e970 0x7fed500b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:26.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.844+0000 7fed55279640 10 monclient: _finish_hunting 0 2024-04-09T12:05:26.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.844+0000 7fed55279640 1 monclient: found mon.noname-c 2024-04-09T12:05:26.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.844+0000 7fed55279640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:26.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.844+0000 7fed55279640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:05:26.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.844+0000 7fed55279640 1 -- 172.21.15.29:0/3060002798 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed38009400 con 0x7fed50144c50 2024-04-09T12:05:26.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.846+0000 7fed55279640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed50144c50 0x7fed500b74a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed4800ca80 tx=0x7fed4800cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:26.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.846+0000 7fed4d7fa640 10 client.?.objecter ms_handle_connect 0x7fed50144c50 2024-04-09T12:05:26.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.846+0000 7fed4d7fa640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:26.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 1 -- 172.21.15.29:0/3060002798 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4800ac30 con 0x7fed50144c50 2024-04-09T12:05:26.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:26.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:26.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 10 monclient: dump: 2024-04-09T12:05:26.853 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:26.853 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:26.854 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.854 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.854 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:26.854 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 10 monclient: _finish_auth 0 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 10 monclient: _check_auth_tickets 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 1 -- 172.21.15.29:0/3060002798 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4800ad90 con 0x7fed50144c50 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 1 -- 172.21.15.29:0/3060002798 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48012600 con 0x7fed50144c50 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4d7fa640 10 monclient: dump: 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed56cdc640 5 monclient: authenticate success, global_id 4316 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed56cdc640 10 monclient: _renew_subs 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed56cdc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed56cdc640 1 -- 172.21.15.29:0/3060002798 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed50143d10 con 0x7fed50144c50 2024-04-09T12:05:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed4effd640 4 set_mon_vals no callback set 2024-04-09T12:05:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed56cdc640 10 client.4316.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed56cdc640 10 monclient: _renew_subs 2024-04-09T12:05:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed56cdc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed56cdc640 1 -- 172.21.15.29:0/3060002798 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed501448e0 con 0x7fed50144c50 2024-04-09T12:05:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.850+0000 7fed56cdc640 1 librados: init done 2024-04-09T12:05:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.851+0000 7fed56cdc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:26.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.851+0000 7fed56cdc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:26.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.851+0000 7fed56cdc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:26.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:26.851+0000 7fed56cdc640 1 -- 172.21.15.29:0/3060002798 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed500b58f0 con 0x7fed50144c50 2024-04-09T12:05:27.034 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-09T12:05:27.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.049+0000 7f09eaffd640 1 -- 172.21.15.29:0/4193369700 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f09e4044790 con 0x7f09f40a8f10 2024-04-09T12:05:27.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.049+0000 7f09eaffd640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f09d406c5e0 0x7f09d406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.050+0000 7f09ebfff640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f09d406c5e0 0x7f09d406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.050+0000 7f09ebfff640 10 monclient: get_auth_request con 0x7f09d406c5e0 auth_method 0 2024-04-09T12:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.050+0000 7f09ebfff640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f09d406c5e0 0x7f09d406eaa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09f40b0e90 tx=0x7f09dc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.050+0000 7f09eaffd640 10 client.4393.objecter ms_handle_connect 0x7f09d406c5e0 2024-04-09T12:05:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.052+0000 7f09eaffd640 1 -- 172.21.15.29:0/4193369700 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f09e402d040 con 0x7f09f40a8f10 2024-04-09T12:05:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.052+0000 7f09eaffd640 10 client.4393.objecter ms_dispatch 0x7f09f4000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.052+0000 7f09eaffd640 3 client.4393.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.052+0000 7f09eaffd640 3 client.4393.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.052+0000 7f09eaffd640 20 client.4393.objecter dump_active .. 0 homeless 2024-04-09T12:05:27.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.063+0000 7f09eaffd640 1 -- 172.21.15.29:0/4193369700 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f09e4077410 con 0x7f09f40a8f10 2024-04-09T12:05:27.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.063+0000 7f09eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.063+0000 7f09eaffd640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:27.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.122+0000 7fed4d7fa640 1 -- 172.21.15.29:0/3060002798 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fed48007070 con 0x7fed50144c50 2024-04-09T12:05:27.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.122+0000 7fed4d7fa640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fed3006c5c0 0x7fed3006ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.123+0000 7fed54a78640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fed3006c5c0 0x7fed3006ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.123+0000 7fed54a78640 10 monclient: get_auth_request con 0x7fed3006c5c0 auth_method 0 2024-04-09T12:05:27.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.123+0000 7fed54a78640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fed3006c5c0 0x7fed3006ea80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed38036000 tx=0x7fed38030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.123+0000 7fed4d7fa640 10 client.4316.objecter ms_handle_connect 0x7fed3006c5c0 2024-04-09T12:05:27.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.136+0000 7fed4d7fa640 1 -- 172.21.15.29:0/3060002798 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fed480583e0 con 0x7fed50144c50 2024-04-09T12:05:27.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.136+0000 7fed4d7fa640 10 client.4316.objecter ms_dispatch 0x7fed50000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:27.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.136+0000 7fed4d7fa640 3 client.4316.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:27.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.136+0000 7fed4d7fa640 3 client.4316.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:27.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.136+0000 7fed4d7fa640 20 client.4316.objecter dump_active .. 0 homeless 2024-04-09T12:05:27.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.136+0000 7fed4d7fa640 1 -- 172.21.15.29:0/3060002798 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fed48054720 con 0x7fed50144c50 2024-04-09T12:05:27.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.136+0000 7fed4d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.136+0000 7fed4d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:27.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.169+0000 7f3c0f6ae640 10 monclient: get_monmap_and_config 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.169+0000 7f3c0f6ae640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.169+0000 7f3c0f6ae640 10 monclient: monmap: 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:27.170568+0000 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:27.170568+0000 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:27.173 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.169+0000 7f3c0f6ae640 1 Processor -- start 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.169+0000 7f3c0f6ae640 1 -- start start 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.169+0000 7f3c0f6ae640 10 monclient: init 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 0x7f3c080a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 10 monclient(hunting): picked mon.noname-b con 0x7f3c080b7b10 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3c080a8f10 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3c0813f1b0 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c080aa840 con 0x7f3c080a8f10 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c080a93c0 con 0x7f3c0813f1b0 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080b7ef0 con 0x7f3c080b7b10 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.170+0000 7f3c0f6ae640 10 monclient(hunting): authenticate will time out at 1393.290455s 2024-04-09T12:05:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.171+0000 7f3c0d44a640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 0x7f3c080a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.171+0000 7f3c0dc4b640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3c0813f1b0 0x7f3c08144d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:37844/0 (socket says 172.21.15.29:37844) 2024-04-09T12:05:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.171+0000 7f3c0dc4b640 1 -- 172.21.15.29:0/3296222231 learned_addr learned my addr 172.21.15.29:0/3296222231 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.171+0000 7f3c0d44a640 10 monclient(hunting): get_auth_request con 0x7f3c080b7b10 auth_method 0 2024-04-09T12:05:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.171+0000 7f3c0d44a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.171+0000 7f3c0d44a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.171+0000 7f3c0d44a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.172+0000 7f3c0d44a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.172+0000 7f3c0d44a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.172+0000 7f3c0d44a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3bfffff640 1 -- 172.21.15.29:0/3296222231 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934527387 0 0) 0x7f3c080a93c0 con 0x7f3c0813f1b0 2024-04-09T12:05:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3bfffff640 10 monclient(hunting): _negotiate 2024-04-09T12:05:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3bfffff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3bfffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3bfffff640 10 monclient(hunting): my global_id is 4396 2024-04-09T12:05:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3bfffff640 1 -- 172.21.15.29:0/3296222231 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bf4003520 con 0x7f3c0813f1b0 2024-04-09T12:05:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3c0d44a640 10 monclient(hunting): handle_auth_done global_id 4319 payload 274 2024-04-09T12:05:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3c0d44a640 1 -- 172.21.15.29:0/3296222231 >> v1:172.21.15.173:6789/0 conn(0x7f3c0813f1b0 legacy=0x7f3c08144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3c0d44a640 1 -- 172.21.15.29:0/3296222231 >> v1:172.21.15.29:6789/0 conn(0x7f3c080a8f10 legacy=0x7f3c0813eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3c0d44a640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3c0d44a640 1 monclient: found mon.noname-b 2024-04-09T12:05:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3c0d44a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3c0d44a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.174+0000 7f3c0d44a640 1 -- 172.21.15.29:0/3296222231 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08145470 con 0x7f3c080b7b10 2024-04-09T12:05:27.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.176+0000 7f3c0d44a640 1 --2- 172.21.15.29:0/3296222231 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 0x7f3c080a89d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3c040097d0 tx=0x7f3c0402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb526839512a5a75 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.180 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-09T12:05:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 1 -- 172.21.15.29:0/3296222231 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04031890 con 0x7f3c080b7b10 2024-04-09T12:05:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 10 monclient: dump: 2024-04-09T12:05:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 1 -- 172.21.15.29:0/3296222231 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c040319f0 con 0x7f3c080b7b10 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3c0f6ae640 5 monclient: authenticate success, global_id 4319 2024-04-09T12:05:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3c0f6ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3c0f6ae640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3c0f6ae640 4 set_mon_vals no callback set 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 1 -- 172.21.15.29:0/3296222231 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04031d80 con 0x7f3c080b7b10 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.180+0000 7f3bfffff640 10 monclient: dump: 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.186 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.186 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.181+0000 7f3c0f6ae640 10 monclient: shutdown 2024-04-09T12:05:27.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.181+0000 7f3c0f6ae640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:27.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.181+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3296222231 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 msgr2=0x7f3c080a89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.181+0000 7f3c0f6ae640 1 --2- 172.21.15.29:0/3296222231 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 0x7f3c080a89d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3c040097d0 tx=0x7f3c0402b930 comp rx=0 tx=0).stop 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.181+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3296222231 shutdown_connections 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.181+0000 7f3c0f6ae640 1 --2- 172.21.15.29:0/3296222231 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 0x7f3c080a89d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.181+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3296222231 >> 172.21.15.29:0/3296222231 conn(0x7f3c08066140 msgr2=0x7f3c080b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.181+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3296222231 shutdown_connections 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.181+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3296222231 wait complete. 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.182+0000 7f3c0f6ae640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.182+0000 7f3c0f6ae640 10 monclient: monmap: 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.182+0000 7f3c0f6ae640 1 librados: starting msgr at 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.182+0000 7f3c0f6ae640 1 librados: starting objecter 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.182+0000 7f3c0f6ae640 1 Processor -- start 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.182+0000 7f3c0f6ae640 1 -- start start 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.182+0000 7f3c0f6ae640 1 librados: setting wanted keys 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.182+0000 7f3c0f6ae640 1 librados: calling monclient init 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.182+0000 7f3c0f6ae640 10 monclient: init 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c080a8f10 0x7f3c08140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 10 monclient(hunting): picked mon.noname-a con 0x7f3c080a8f10 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 0x7f3c081da570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 10 monclient(hunting): picked mon.noname-c con 0x7f3c080b7b10 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0813f1b0 0x7f3c08130e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 10 monclient(hunting): picked mon.noname-b con 0x7f3c0813f1b0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c08141900 con 0x7f3c080a8f10 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0813fa00 con 0x7f3c0813f1b0 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0814cce0 con 0x7f3c080b7b10 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.183+0000 7f3c0f6ae640 10 monclient(hunting): authenticate will time out at 1393.303680s 2024-04-09T12:05:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0cc49640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 0x7f3c081da570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0dc4b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0813f1b0 0x7f3c08130e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0d44a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c080a8f10 0x7f3c08140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0cc49640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 0x7f3c081da570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:56130/0 (socket says 172.21.15.29:56130) 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0cc49640 1 -- 172.21.15.29:0/3895368644 learned_addr learned my addr 172.21.15.29:0/3895368644 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0cc49640 10 monclient(hunting): get_auth_request con 0x7f3c080b7b10 auth_method 0 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0cc49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0cc49640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0cc49640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0dc4b640 10 monclient(hunting): get_auth_request con 0x7f3c0813f1b0 auth_method 0 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0dc4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0dc4b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0dc4b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0d44a640 10 monclient(hunting): get_auth_request con 0x7f3c080a8f10 auth_method 0 2024-04-09T12:05:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0d44a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0d44a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.184+0000 7f3c0d44a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.185+0000 7f3c0dc4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.185+0000 7f3c0dc4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.185+0000 7f3c0dc4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.185+0000 7f3c0cc49640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.185+0000 7f3c0cc49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.185+0000 7f3c0cc49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.185+0000 7f3c0d44a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.185+0000 7f3c0d44a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.185+0000 7f3c0d44a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.187+0000 7f3c0dc4b640 10 monclient(hunting): handle_auth_done global_id 4399 payload 824 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.187+0000 7f3c0dc4b640 1 -- 172.21.15.29:0/3895368644 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 msgr2=0x7f3c081da570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.187+0000 7f3c0dc4b640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 0x7f3c081da570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.187+0000 7f3c0dc4b640 1 -- 172.21.15.29:0/3895368644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c080a8f10 msgr2=0x7f3c08140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.187+0000 7f3c0dc4b640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c080a8f10 0x7f3c08140cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.187+0000 7f3c0dc4b640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.187+0000 7f3c0dc4b640 1 monclient: found mon.noname-b 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.187+0000 7f3c0dc4b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.187+0000 7f3c0dc4b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.187+0000 7f3c0dc4b640 1 -- 172.21.15.29:0/3895368644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c04009400 con 0x7f3c0813f1b0 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.190+0000 7f3c0dc4b640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0813f1b0 0x7f3c08130e90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000ca70 tx=0x7f3c0000ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.190+0000 7f3bfdffb640 10 client.?.objecter ms_handle_connect 0x7f3c0813f1b0 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.190+0000 7f3bfdffb640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3895368644 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0000ab10 con 0x7f3c0813f1b0 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 10 monclient: dump: 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3895368644 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0000ac70 con 0x7f3c0813f1b0 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3895368644 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00012600 con 0x7f3c0813f1b0 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bfdffb640 10 monclient: dump: 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3c0f6ae640 5 monclient: authenticate success, global_id 4399 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3c0f6ae640 10 monclient: _renew_subs 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3c0f6ae640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3895368644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c08141dc0 con 0x7f3c0813f1b0 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.193+0000 7f3bff7fe640 4 set_mon_vals no callback set 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.194+0000 7f3c0f6ae640 10 client.4399.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.194+0000 7f3c0f6ae640 10 monclient: _renew_subs 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.194+0000 7f3c0f6ae640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.194+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3895368644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c081daab0 con 0x7f3c0813f1b0 2024-04-09T12:05:27.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.194+0000 7f3c0f6ae640 1 librados: init done 2024-04-09T12:05:27.201 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-09T12:05:27.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.194+0000 7f3c0f6ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.195+0000 7f3c0f6ae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.195+0000 7f3c0f6ae640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.195+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3895368644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0814ce20 con 0x7f3c0813f1b0 2024-04-09T12:05:27.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.212+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3895368644 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c00007070 con 0x7f3c0813f1b0 2024-04-09T12:05:27.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.212+0000 7f3bfdffb640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3bec06c610 0x7f3bec06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.213+0000 7f3c0d44a640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3bec06c610 0x7f3bec06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.213+0000 7f3c0d44a640 10 monclient: get_auth_request con 0x7f3bec06c610 auth_method 0 2024-04-09T12:05:27.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.213+0000 7f3c0d44a640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3bec06c610 0x7f3bec06ead0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c04036000 tx=0x7f3c0403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.213+0000 7f3bfdffb640 10 client.4399.objecter ms_handle_connect 0x7f3bec06c610 2024-04-09T12:05:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.215+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3895368644 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3c0000ae20 con 0x7f3c0813f1b0 2024-04-09T12:05:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.215+0000 7f3bfdffb640 10 client.4399.objecter ms_dispatch 0x7f3c08000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.215+0000 7f3bfdffb640 3 client.4399.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.215+0000 7f3bfdffb640 3 client.4399.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.215+0000 7f3bfdffb640 20 client.4399.objecter dump_active .. 0 homeless 2024-04-09T12:05:27.221 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-09T12:05:27.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.305+0000 7f09f8a86640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-09T12:05:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.305+0000 7f09f8a86640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-09T12:05:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.305+0000 7f09f8a86640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.305+0000 7f09f8a86640 1 -- 172.21.15.29:0/4193369700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09f40b2ec0 con 0x7f09f40a8f10 2024-04-09T12:05:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.305+0000 7f00e5177640 10 monclient: get_monmap_and_config 2024-04-09T12:05:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.305+0000 7f00e5177640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.305+0000 7f00e5177640 10 monclient: monmap: 2024-04-09T12:05:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:27.307191+0000 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:27.307191+0000 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.306+0000 7f00e5177640 1 Processor -- start 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.306+0000 7f00e5177640 1 -- start start 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.306+0000 7f00e5177640 10 monclient: init 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.306+0000 7f00e5177640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.306+0000 7f00e5177640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.306+0000 7f00e5177640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e00b7b10 0x7f00e00a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.306+0000 7f00e5177640 10 monclient(hunting): picked mon.noname-b con 0x7f00e00b7b10 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00e5177640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f00e00a8f10 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00e5177640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f00e013f1b0 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00e5177640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e00aa840 con 0x7f00e00a8f10 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00e5177640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e00a93c0 con 0x7f00e013f1b0 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00e5177640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00e5177640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00b7ef0 con 0x7f00e00b7b10 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00e5177640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00e5177640 10 monclient(hunting): authenticate will time out at 1393.427163s 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00ded9d640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e00b7b10 0x7f00e00a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00de59c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f00e00a8f10 0x7f00e013eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33080/0 (socket says 172.21.15.29:33080) 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00de59c640 1 -- 172.21.15.29:0/2342464462 learned_addr learned my addr 172.21.15.29:0/2342464462 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00ded9d640 10 monclient(hunting): get_auth_request con 0x7f00e00b7b10 auth_method 0 2024-04-09T12:05:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00ded9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00ded9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.307+0000 7f00ded9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.308+0000 7f00ded9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.308+0000 7f00ded9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.308+0000 7f00ded9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.310+0000 7f00ded9d640 10 monclient(hunting): handle_auth_done global_id 4325 payload 274 2024-04-09T12:05:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.310+0000 7f00ded9d640 1 -- 172.21.15.29:0/2342464462 >> v1:172.21.15.173:6789/0 conn(0x7f00e013f1b0 legacy=0x7f00e0144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.310+0000 7f00ded9d640 1 -- 172.21.15.29:0/2342464462 >> v1:172.21.15.29:6789/0 conn(0x7f00e00a8f10 legacy=0x7f00e013eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.310+0000 7f00ded9d640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.310+0000 7f00ded9d640 1 monclient: found mon.noname-b 2024-04-09T12:05:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.310+0000 7f00ded9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.310+0000 7f00ded9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.310+0000 7f00ded9d640 1 -- 172.21.15.29:0/2342464462 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e0145470 con 0x7f00e00b7b10 2024-04-09T12:05:27.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.313+0000 7f00ded9d640 1 --2- 172.21.15.29:0/2342464462 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e00b7b10 0x7f00e00a89d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009dc0 tx=0x7f00d002be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68889c231f64be96 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.314+0000 7f62e114e640 10 monclient: get_monmap_and_config 2024-04-09T12:05:27.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.314+0000 7f62e114e640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.314+0000 7f62e114e640 10 monclient: monmap: 2024-04-09T12:05:27.321 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.321 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.321 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:27.316126+0000 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:27.316126+0000 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.315+0000 7f62e114e640 1 Processor -- start 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.315+0000 7f62e114e640 1 -- start start 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.315+0000 7f62e114e640 10 monclient: init 2024-04-09T12:05:27.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.315+0000 7f62e114e640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f62dc0b7b10 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62dc13eaa0 0x7f62dc13ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 10 monclient(hunting): picked mon.noname-a con 0x7f62dc13eaa0 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62dc144d60 0x7f62dc1451f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 10 monclient(hunting): picked mon.noname-c con 0x7f62dc144d60 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62dc13f450 con 0x7f62dc0b7b10 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62dc0b7ef0 con 0x7f62dc13eaa0 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62dc0aa840 con 0x7f62dc144d60 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62e114e640 10 monclient(hunting): authenticate will time out at 1393.436084s 2024-04-09T12:05:27.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.316+0000 7f62d3fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62dc13eaa0 0x7f62dc13ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.317+0000 7f62d3fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62dc13eaa0 0x7f62dc13ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54300/0 (socket says 172.21.15.29:54300) 2024-04-09T12:05:27.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.317+0000 7f62d3fff640 1 -- 172.21.15.29:0/56748573 learned_addr learned my addr 172.21.15.29:0/56748573 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:27.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.317+0000 7f62d3fff640 10 monclient(hunting): get_auth_request con 0x7f62dc13eaa0 auth_method 0 2024-04-09T12:05:27.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.317+0000 7f62d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.317+0000 7f62d3fff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.317+0000 7f62d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.317+0000 7f62d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.317+0000 7f62d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.317+0000 7f62d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 1 -- 172.21.15.29:0/2342464462 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d002cc40 con 0x7f00e00b7b10 2024-04-09T12:05:27.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:27.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 10 monclient: dump: 2024-04-09T12:05:27.326 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.326 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.326 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.326 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.326 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.326 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.326 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.327 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.327 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.327 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 1 -- 172.21.15.29:0/2342464462 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d002cda0 con 0x7f00e00b7b10 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 1 -- 172.21.15.29:0/2342464462 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0034660 con 0x7f00e00b7b10 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00ddd9b640 10 monclient: dump: 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.328 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.329 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.329 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.329 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00e5177640 5 monclient: authenticate success, global_id 4325 2024-04-09T12:05:27.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00e5177640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:27.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.318+0000 7f00e5177640 4 set_mon_vals no callback set 2024-04-09T12:05:27.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f00e5177640 10 monclient: shutdown 2024-04-09T12:05:27.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f00e5177640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:27.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f00e5177640 1 -- 172.21.15.29:0/2342464462 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e00b7b10 msgr2=0x7f00e00a89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f00e5177640 1 --2- 172.21.15.29:0/2342464462 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e00b7b10 0x7f00e00a89d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009dc0 tx=0x7f00d002be90 comp rx=0 tx=0).stop 2024-04-09T12:05:27.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f00e5177640 1 -- 172.21.15.29:0/2342464462 shutdown_connections 2024-04-09T12:05:27.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f00e5177640 1 --2- 172.21.15.29:0/2342464462 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e00b7b10 0x7f00e00a89d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f00e5177640 1 -- 172.21.15.29:0/2342464462 >> 172.21.15.29:0/2342464462 conn(0x7f00e0066140 msgr2=0x7f00e00b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:27.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f00e5177640 1 -- 172.21.15.29:0/2342464462 shutdown_connections 2024-04-09T12:05:27.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f00e5177640 1 -- 172.21.15.29:0/2342464462 wait complete. 2024-04-09T12:05:27.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f62d3fff640 10 monclient(hunting): handle_auth_done global_id 4332 payload 274 2024-04-09T12:05:27.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f62d3fff640 1 -- 172.21.15.29:0/56748573 >> v2:172.21.15.173:3300/0 conn(0x7f62dc144d60 msgr2=0x7f62dc1451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:27.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f62d3fff640 1 --2- 172.21.15.29:0/56748573 >> v2:172.21.15.173:3300/0 conn(0x7f62dc144d60 0x7f62dc1451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f62d3fff640 1 -- 172.21.15.29:0/56748573 >> v1:172.21.15.173:6789/0 conn(0x7f62dc0b7b10 legacy=0x7f62dc0a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:27.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f62d3fff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f62d3fff640 1 monclient: found mon.noname-a 2024-04-09T12:05:27.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f62d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f62d3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:27.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.319+0000 7f62d3fff640 1 -- 172.21.15.29:0/56748573 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc0a93c0 con 0x7f62dc13eaa0 2024-04-09T12:05:27.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.320+0000 7f00e5177640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.320+0000 7f00e5177640 10 monclient: monmap: 2024-04-09T12:05:27.334 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.334 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:27.334 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:27.334 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:27.334 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.334 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.334 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.320+0000 7f00e5177640 1 librados: starting msgr at 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.320+0000 7f00e5177640 1 librados: starting objecter 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.320+0000 7f00e5177640 1 Processor -- start 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.320+0000 7f00e5177640 1 -- start start 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.320+0000 7f00e5177640 1 librados: setting wanted keys 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.320+0000 7f00e5177640 1 librados: calling monclient init 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.320+0000 7f00e5177640 10 monclient: init 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e00a8f10 0x7f00e00aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 10 monclient(hunting): picked mon.noname-a con 0x7f00e00a8f10 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e00b7b10 0x7f00e00ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 10 monclient(hunting): picked mon.noname-b con 0x7f00e00b7b10 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e013f1b0 0x7f00e006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 10 monclient(hunting): picked mon.noname-c con 0x7f00e013f1b0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00accc0 con 0x7f00e00a8f10 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e006f110 con 0x7f00e00b7b10 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00700a0 con 0x7f00e013f1b0 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.321+0000 7f00e5177640 10 monclient(hunting): authenticate will time out at 1393.441746s 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.322+0000 7f00df59e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e013f1b0 0x7f00e006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.322+0000 7f00df59e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e013f1b0 0x7f00e006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:56146/0 (socket says 172.21.15.29:56146) 2024-04-09T12:05:27.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.322+0000 7f00df59e640 1 -- 172.21.15.29:0/2637682490 learned_addr learned my addr 172.21.15.29:0/2637682490 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:27.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.322+0000 7f00df59e640 10 monclient(hunting): get_auth_request con 0x7f00e013f1b0 auth_method 0 2024-04-09T12:05:27.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.322+0000 7f00df59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.322+0000 7f00df59e640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.322+0000 7f00df59e640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.322+0000 7f00ded9d640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e00a8f10 0x7f00e00aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.323+0000 7f00df59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.323+0000 7f62d3fff640 1 --2- 172.21.15.29:0/56748573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62dc13eaa0 0x7f62dc13ef10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0b1460 tx=0x7f62c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c9550f5ebe891 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.338 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-09T12:05:27.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.323+0000 7f00df59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.323+0000 7f00df59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.323+0000 7f00ded9d640 10 monclient(hunting): get_auth_request con 0x7f00e00a8f10 auth_method 0 2024-04-09T12:05:27.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.323+0000 7f00ded9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.323+0000 7f00ded9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.323+0000 7f00ded9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.325+0000 7f00ded9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.325+0000 7f00ded9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.325+0000 7f00ded9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.327+0000 7f00df59e640 10 monclient(hunting): handle_auth_done global_id 4328 payload 824 2024-04-09T12:05:27.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.327+0000 7f00df59e640 1 -- 172.21.15.29:0/2637682490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e00b7b10 msgr2=0x7f00e00ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.327+0000 7f00df59e640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e00b7b10 0x7f00e00ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.327+0000 7f00df59e640 1 -- 172.21.15.29:0/2637682490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e00a8f10 msgr2=0x7f00e00aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.327+0000 7f00df59e640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e00a8f10 0x7f00e00aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.327+0000 7f00df59e640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.327+0000 7f00df59e640 1 monclient: found mon.noname-c 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.327+0000 7f00df59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.327+0000 7f00df59e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.327+0000 7f00df59e640 1 -- 172.21.15.29:0/2637682490 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d0009a70 con 0x7f00e013f1b0 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.330+0000 7f00df59e640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e013f1b0 0x7f00e006d3d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f00d800b410 tx=0x7f00d800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.330+0000 7f00d77fe640 10 client.?.objecter ms_handle_connect 0x7f00e013f1b0 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.330+0000 7f00d77fe640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 1 -- 172.21.15.29:0/2637682490 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8011830 con 0x7f00e013f1b0 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 10 monclient: dump: 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 1 -- 172.21.15.29:0/2637682490 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d8011990 con 0x7f00e013f1b0 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 1 -- 172.21.15.29:0/2637682490 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8011d40 con 0x7f00e013f1b0 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00d77fe640 10 monclient: dump: 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00dd59a640 4 set_mon_vals no callback set 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00e5177640 5 monclient: authenticate success, global_id 4328 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00e5177640 10 monclient: _renew_subs 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00e5177640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00e5177640 1 -- 172.21.15.29:0/2637682490 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e00aba00 con 0x7f00e013f1b0 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00e5177640 10 client.4328.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00e5177640 10 monclient: _renew_subs 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00e5177640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00e5177640 1 -- 172.21.15.29:0/2637682490 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e006daf0 con 0x7f00e013f1b0 2024-04-09T12:05:27.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.335+0000 7f00e5177640 1 librados: init done 2024-04-09T12:05:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 1 -- 172.21.15.29:0/56748573 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4031870 con 0x7f62dc13eaa0 2024-04-09T12:05:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 10 monclient: dump: 2024-04-09T12:05:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 1 -- 172.21.15.29:0/56748573 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c40319d0 con 0x7f62dc13eaa0 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 1 -- 172.21.15.29:0/56748573 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4031d60 con 0x7f62dc13eaa0 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62da59c640 10 monclient: dump: 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62e114e640 5 monclient: authenticate success, global_id 4332 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62e114e640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:27.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f62e114e640 4 set_mon_vals no callback set 2024-04-09T12:05:27.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f00e5177640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f00e5177640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f00e5177640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.336+0000 7f00e5177640 1 -- 172.21.15.29:0/2637682490 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e00acb30 con 0x7f00e013f1b0 2024-04-09T12:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.337+0000 7f62e114e640 10 monclient: shutdown 2024-04-09T12:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.337+0000 7f62e114e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.337+0000 7f62e114e640 1 -- 172.21.15.29:0/56748573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62dc13eaa0 msgr2=0x7f62dc13ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.337+0000 7f62e114e640 1 --2- 172.21.15.29:0/56748573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62dc13eaa0 0x7f62dc13ef10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0b1460 tx=0x7f62c402b910 comp rx=0 tx=0).stop 2024-04-09T12:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.337+0000 7f62e114e640 1 -- 172.21.15.29:0/56748573 shutdown_connections 2024-04-09T12:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.337+0000 7f62e114e640 1 --2- 172.21.15.29:0/56748573 >> v2:172.21.15.173:3300/0 conn(0x7f62dc144d60 0x7f62dc1451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.337+0000 7f62e114e640 1 --2- 172.21.15.29:0/56748573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62dc13eaa0 0x7f62dc13ef10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.337+0000 7f62e114e640 1 -- 172.21.15.29:0/56748573 >> 172.21.15.29:0/56748573 conn(0x7f62dc066140 msgr2=0x7f62dc0b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.337+0000 7f62e114e640 1 -- 172.21.15.29:0/56748573 shutdown_connections 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.337+0000 7f62e114e640 1 -- 172.21.15.29:0/56748573 wait complete. 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.338+0000 7f62e114e640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.338+0000 7f62e114e640 10 monclient: monmap: 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.338+0000 7f62e114e640 1 librados: starting msgr at 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.338+0000 7f62e114e640 1 librados: starting objecter 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.338+0000 7f62e114e640 1 Processor -- start 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.338+0000 7f62e114e640 1 -- start start 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.338+0000 7f62e114e640 1 librados: setting wanted keys 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.338+0000 7f62e114e640 1 librados: calling monclient init 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.338+0000 7f62e114e640 10 monclient: init 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62dc0b7b10 0x7f62dc138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 10 monclient(hunting): picked mon.noname-b con 0x7f62dc0b7b10 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62dc13eaa0 0x7f62dc1de530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 10 monclient(hunting): picked mon.noname-a con 0x7f62dc13eaa0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62dc144d60 0x7f62dc1dea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 10 monclient(hunting): picked mon.noname-c con 0x7f62dc144d60 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc132af0 con 0x7f62dc13eaa0 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc1defb0 con 0x7f62dc0b7b10 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc139ee0 con 0x7f62dc144d60 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.339+0000 7f62e114e640 10 monclient(hunting): authenticate will time out at 1393.459815s 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.340+0000 7f62d3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62dc13eaa0 0x7f62dc1de530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.340+0000 7f62d3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62dc13eaa0 0x7f62dc1de530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54314/0 (socket says 172.21.15.29:54314) 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.340+0000 7f62d3fff640 1 -- 172.21.15.29:0/493320257 learned_addr learned my addr 172.21.15.29:0/493320257 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.340+0000 7f62d3fff640 10 monclient(hunting): get_auth_request con 0x7f62dc13eaa0 auth_method 0 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.340+0000 7f62d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.340+0000 7f62d3fff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.340+0000 7f62d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.341+0000 7f62d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.341+0000 7f62d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.341+0000 7f62d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.344+0000 7f62d3fff640 10 monclient(hunting): handle_auth_done global_id 4338 payload 824 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.344+0000 7f62d3fff640 1 -- 172.21.15.29:0/493320257 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62dc144d60 msgr2=0x7f62dc1dea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.344+0000 7f62d3fff640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62dc144d60 0x7f62dc1dea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.344+0000 7f62d3fff640 1 -- 172.21.15.29:0/493320257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62dc0b7b10 msgr2=0x7f62dc138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.344+0000 7f62d3fff640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62dc0b7b10 0x7f62dc138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.344+0000 7f62d3fff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.344+0000 7f62d3fff640 1 monclient: found mon.noname-a 2024-04-09T12:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.344+0000 7f62d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.344+0000 7f62d3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.344+0000 7f62d3fff640 1 -- 172.21.15.29:0/493320257 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40094d0 con 0x7f62dc13eaa0 2024-04-09T12:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.347+0000 7f62d3fff640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62dc13eaa0 0x7f62dc1de530 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f62c402bf20 tx=0x7f62c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.347+0000 7f62d37fe640 10 client.?.objecter ms_handle_connect 0x7f62dc13eaa0 2024-04-09T12:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.347+0000 7f62d37fe640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7fed56cdc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-09T12:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7fed56cdc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-09T12:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7fed56cdc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7fed56cdc640 1 -- 172.21.15.29:0/3060002798 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fed500b58f0 con 0x7fed50144c50 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 1 -- 172.21.15.29:0/493320257 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c403adf0 con 0x7f62dc13eaa0 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 10 monclient: dump: 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.360 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 1 -- 172.21.15.29:0/493320257 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c40443f0 con 0x7f62dc13eaa0 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 1 -- 172.21.15.29:0/493320257 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c40447a0 con 0x7f62dc13eaa0 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d37fe640 10 monclient: dump: 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62e114e640 5 monclient: authenticate success, global_id 4338 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62d9d9b640 4 set_mon_vals no callback set 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62e114e640 10 monclient: _renew_subs 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62e114e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62e114e640 1 -- 172.21.15.29:0/493320257 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62dc13a150 con 0x7f62dc13eaa0 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62e114e640 10 client.4338.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:27.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62e114e640 10 monclient: _renew_subs 2024-04-09T12:05:27.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62e114e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:27.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62e114e640 1 -- 172.21.15.29:0/493320257 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62dc139020 con 0x7f62dc13eaa0 2024-04-09T12:05:27.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.353+0000 7f62e114e640 1 librados: init done 2024-04-09T12:05:27.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.354+0000 7f62e114e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.354+0000 7f62e114e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.354+0000 7f62e114e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:27.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.354+0000 7f62e114e640 1 -- 172.21.15.29:0/493320257 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62dc04e160 con 0x7f62dc13eaa0 2024-04-09T12:05:27.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.358+0000 7fc38dc2a640 10 monclient: get_monmap_and_config 2024-04-09T12:05:27.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.358+0000 7fc38dc2a640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.358+0000 7fc38dc2a640 10 monclient: monmap: 2024-04-09T12:05:27.364 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.364 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.364 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:27.360370+0000 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:27.360370+0000 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.359+0000 7fc38dc2a640 1 Processor -- start 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.359+0000 7fc38dc2a640 1 -- start start 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.359+0000 7fc38dc2a640 10 monclient: init 2024-04-09T12:05:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 10 monclient: _add_conns ranks=[1,0,2,3,4] 2024-04-09T12:05:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc3880b43d0 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc38813f080 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc388145360 0x7fc3880a8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 10 monclient(hunting): picked mon.noname-b con 0x7fc388145360 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3880aa750 con 0x7fc38813f080 2024-04-09T12:05:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3880a9060 con 0x7fc3880b43d0 2024-04-09T12:05:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880a8e80 con 0x7fc388145360 2024-04-09T12:05:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.360+0000 7fc38dc2a640 10 monclient(hunting): authenticate will time out at 1393.480343s 2024-04-09T12:05:27.393 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-09T12:05:27.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.451+0000 7f09eaffd640 1 -- 172.21.15.29:0/4193369700 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09e4035090 con 0x7f09f40a8f10 2024-04-09T12:05:27.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.451+0000 7f09eaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-09T12:05:27.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.451+0000 7f09eaffd640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:27.455 INFO:teuthology.orchestra.run.smithi029.stdout:64424509445 2024-04-09T12:05:27.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.452+0000 7f0fc4d2a640 10 monclient: get_monmap_and_config 2024-04-09T12:05:27.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.452+0000 7f0fc4d2a640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.452+0000 7f0fc4d2a640 10 monclient: monmap: 2024-04-09T12:05:27.455 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.456 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.456 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:27.454273+0000 2024-04-09T12:05:27.456 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:27.454273+0000 2024-04-09T12:05:27.456 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.456 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.456 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:27.456 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:27.456 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:27.456 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:27.456 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:27.456 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.453+0000 7f0fc4d2a640 1 Processor -- start 2024-04-09T12:05:27.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.453+0000 7f0fc4d2a640 1 -- start start 2024-04-09T12:05:27.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.453+0000 7f0fc4d2a640 10 monclient: init 2024-04-09T12:05:27.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 10 librados: watch_flush enter 2024-04-09T12:05:27.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 10 librados: watch_flush exit 2024-04-09T12:05:27.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 20 client.4393.objecter shutdown clearing up homeless session... 2024-04-09T12:05:27.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 10 client.4393.objecter successfully canceled tick 2024-04-09T12:05:27.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 -- 172.21.15.29:0/4193369700 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f09d406c5e0 msgr2=0x7f09d406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f09d406c5e0 0x7f09d406eaa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09f40b0e90 tx=0x7f09dc009190 comp rx=0 tx=0).stop 2024-04-09T12:05:27.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 10 monclient: shutdown 2024-04-09T12:05:27.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:27.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 -- 172.21.15.29:0/4193369700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09f40a8f10 msgr2=0x7f09f40adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09f40a8f10 0x7f09f40adff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f09f40b8130 tx=0x7f09e40046c0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 -- 172.21.15.29:0/4193369700 shutdown_connections 2024-04-09T12:05:27.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f09d406c5e0 0x7f09d406eaa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2024-04-09T12:05:27.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0fc00b43d0 0x7f0fc00a8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 10 monclient(hunting): picked mon.noname-c con 0x7f0fc00b43d0 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:27.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0fc013e970 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:27.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09f413efe0 0x7f09f413a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09f40b7b10 0x7f09f40ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 --2- 172.21.15.29:0/4193369700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09f40a8f10 0x7f09f40adff0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 -- 172.21.15.29:0/4193369700 >> 172.21.15.29:0/4193369700 conn(0x7f09f4066140 msgr2=0x7f09f40b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:27.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0fc0144c50 0x7f0fc01450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 10 monclient(hunting): picked mon.noname-b con 0x7f0fc0144c50 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:27.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc00aa750 con 0x7f0fc013e970 2024-04-09T12:05:27.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc00a8e80 con 0x7f0fc00b43d0 2024-04-09T12:05:27.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00b47b0 con 0x7f0fc0144c50 2024-04-09T12:05:27.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f0fc4d2a640 10 monclient(hunting): authenticate will time out at 1393.574490s 2024-04-09T12:05:27.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 -- 172.21.15.29:0/4193369700 shutdown_connections 2024-04-09T12:05:27.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 -- 172.21.15.29:0/4193369700 wait complete. 2024-04-09T12:05:27.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.454+0000 7f09f8a86640 1 librados: shutdown 2024-04-09T12:05:27.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.464+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3895368644 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f3c000547f0 con 0x7f3c0813f1b0 2024-04-09T12:05:27.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.464+0000 7f3bfdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.464+0000 7f3bfdffb640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:27.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.469+0000 7fc3877fe640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc3880b43d0 0x7fc38813e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:37886/0 (socket says 172.21.15.29:37886) 2024-04-09T12:05:27.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.469+0000 7fc3877fe640 1 -- 172.21.15.29:0/14244099 learned_addr learned my addr 172.21.15.29:0/14244099 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:27.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-04-09T12:05:27.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.470+0000 7f0fbe59c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0fc00b43d0 0x7f0fc00a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.471+0000 7f0fbe59c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0fc00b43d0 0x7f0fc00a8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:46726/0 (socket says 172.21.15.29:46726) 2024-04-09T12:05:27.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.471+0000 7f0fbe59c640 1 -- 172.21.15.29:0/122916727 learned_addr learned my addr 172.21.15.29:0/122916727 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:27.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.471+0000 7f0fbe59c640 10 monclient(hunting): get_auth_request con 0x7f0fc00b43d0 auth_method 0 2024-04-09T12:05:27.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.471+0000 7f0fbe59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.471+0000 7f0fbe59c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.471+0000 7f0fbe59c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.472+0000 7f0fbe59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.472+0000 7f0fbe59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.472+0000 7f0fbe59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.474+0000 7f0fbe59c640 10 monclient(hunting): handle_auth_done global_id 4402 payload 274 2024-04-09T12:05:27.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.474+0000 7f0fbe59c640 1 -- 172.21.15.29:0/122916727 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0fc0144c50 msgr2=0x7f0fc01450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:27.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.474+0000 7f0fbe59c640 1 --2- 172.21.15.29:0/122916727 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0fc0144c50 0x7f0fc01450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.474+0000 7f0fbe59c640 1 -- 172.21.15.29:0/122916727 >> v1:172.21.15.173:6789/0 conn(0x7f0fc013e970 legacy=0x7f0fc013edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:27.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.474+0000 7f0fbe59c640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.474+0000 7f0fbe59c640 1 monclient: found mon.noname-c 2024-04-09T12:05:27.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.474+0000 7f0fbe59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.474+0000 7f0fbe59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.474+0000 7f0fbe59c640 1 -- 172.21.15.29:0/122916727 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc00a9060 con 0x7f0fc00b43d0 2024-04-09T12:05:27.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.478+0000 7f0fbe59c640 1 --2- 172.21.15.29:0/122916727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc00b43d0 0x7f0fc00a8940 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00098a0 tx=0x7f0fb002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=915033fc8bcb9d16 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.481+0000 7f00d77fe640 1 -- 172.21.15.29:0/2637682490 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f00d801a400 con 0x7f00e013f1b0 2024-04-09T12:05:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.481+0000 7f00d77fe640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f00c006c5c0 0x7f00c006ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.481+0000 7f00ded9d640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f00c006c5c0 0x7f00c006ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.481+0000 7f00ded9d640 10 monclient: get_auth_request con 0x7f00c006c5c0 auth_method 0 2024-04-09T12:05:27.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.482+0000 7f00d77fe640 10 client.4328.objecter ms_handle_connect 0x7f00c006c5c0 2024-04-09T12:05:27.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.482+0000 7f00ded9d640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f00c006c5c0 0x7f00c006ea80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00d0036000 tx=0x7f00d0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 1 -- 172.21.15.29:0/122916727 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0031640 con 0x7f0fc00b43d0 2024-04-09T12:05:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 10 monclient: dump: 2024-04-09T12:05:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 1 -- 172.21.15.29:0/122916727 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb00317a0 con 0x7f0fc00b43d0 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fc4d2a640 5 monclient: authenticate success, global_id 4402 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fc4d2a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 1 -- 172.21.15.29:0/122916727 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0031b30 con 0x7f0fc00b43d0 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fc4d2a640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fc4d2a640 4 set_mon_vals no callback set 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.483+0000 7f0fbd59a640 10 monclient: dump: 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.488 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.484+0000 7f0fc4d2a640 10 monclient: shutdown 2024-04-09T12:05:27.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.484+0000 7f0fc4d2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:27.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.484+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/122916727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc00b43d0 msgr2=0x7f0fc00a8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.484+0000 7f0fc4d2a640 1 --2- 172.21.15.29:0/122916727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc00b43d0 0x7f0fc00a8940 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00098a0 tx=0x7f0fb002b8f0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.484+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/122916727 shutdown_connections 2024-04-09T12:05:27.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.484+0000 7f0fc4d2a640 1 --2- 172.21.15.29:0/122916727 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0fc0144c50 0x7f0fc01450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.484+0000 7f0fc4d2a640 1 --2- 172.21.15.29:0/122916727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc00b43d0 0x7f0fc00a8940 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.484+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/122916727 >> 172.21.15.29:0/122916727 conn(0x7f0fc0065f30 msgr2=0x7f0fc0066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.484+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/122916727 shutdown_connections 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.484+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/122916727 wait complete. 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.485+0000 7f0fc4d2a640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.485+0000 7f0fc4d2a640 10 monclient: monmap: 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:27.492 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.485+0000 7f0fc4d2a640 1 librados: starting msgr at 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.485+0000 7f0fc4d2a640 1 librados: starting objecter 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.486+0000 7f0fc4d2a640 1 Processor -- start 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.486+0000 7f0fc4d2a640 1 -- start start 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.486+0000 7f0fc4d2a640 1 librados: setting wanted keys 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.486+0000 7f0fc4d2a640 1 librados: calling monclient init 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.486+0000 7f0fc4d2a640 10 monclient: init 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.486+0000 7f0fc4d2a640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.486+0000 7f0fc4d2a640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.486+0000 7f0fc4d2a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc00b43d0 0x7f0fc01328a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.486+0000 7f0fc4d2a640 10 monclient(hunting): picked mon.noname-b con 0x7f0fc00b43d0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.486+0000 7f0fc4d2a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fc013e970 0x7f0fc00b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fc4d2a640 10 monclient(hunting): picked mon.noname-a con 0x7f0fc013e970 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fc4d2a640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0fc0144c50 0x7f0fc00b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fc4d2a640 10 monclient(hunting): picked mon.noname-c con 0x7f0fc0144c50 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fc4d2a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fc4d2a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0142f10 con 0x7f0fc013e970 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fc4d2a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fc4d2a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00b4e20 con 0x7f0fc00b43d0 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fc4d2a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fc4d2a640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc013d6b0 con 0x7f0fc0144c50 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fc4d2a640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fc4d2a640 10 monclient(hunting): authenticate will time out at 1393.607276s 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.487+0000 7f0fbe59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc00b43d0 0x7f0fc01328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.488+0000 7f0fbe59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc00b43d0 0x7f0fc01328a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:46738/0 (socket says 172.21.15.29:46738) 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.488+0000 7f0fbe59c640 1 -- 172.21.15.29:0/1137134325 learned_addr learned my addr 172.21.15.29:0/1137134325 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.488+0000 7f0fbe59c640 10 monclient(hunting): get_auth_request con 0x7f0fc00b43d0 auth_method 0 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.488+0000 7f0fbe59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.488+0000 7f0fbe59c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.488+0000 7f0fbe59c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.488+0000 7f0fbe59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.488+0000 7f0fbe59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.488+0000 7f0fbe59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.491+0000 7f0fbe59c640 10 monclient(hunting): handle_auth_done global_id 4405 payload 824 2024-04-09T12:05:27.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.491+0000 7f0fbe59c640 1 -- 172.21.15.29:0/1137134325 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0fc0144c50 msgr2=0x7f0fc00b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.491+0000 7f0fbe59c640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0fc0144c50 0x7f0fc00b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.491+0000 7f0fbe59c640 1 -- 172.21.15.29:0/1137134325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fc013e970 msgr2=0x7f0fc00b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.491+0000 7f0fbe59c640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fc013e970 0x7f0fc00b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.491+0000 7f0fbe59c640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.491+0000 7f0fbe59c640 1 monclient: found mon.noname-b 2024-04-09T12:05:27.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.491+0000 7f0fbe59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.491+0000 7f0fbe59c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.491+0000 7f0fbe59c640 1 -- 172.21.15.29:0/1137134325 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb00094d0 con 0x7f0fc00b43d0 2024-04-09T12:05:27.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.493+0000 7f0fbe59c640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc00b43d0 0x7f0fc01328a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00098a0 tx=0x7f0fb00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.493+0000 7f0faeffd640 10 client.?.objecter ms_handle_connect 0x7f0fc00b43d0 2024-04-09T12:05:27.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.493+0000 7f0faeffd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:27.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 1 -- 172.21.15.29:0/1137134325 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb003ac60 con 0x7f0fc00b43d0 2024-04-09T12:05:27.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:27.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 10 monclient: dump: 2024-04-09T12:05:27.500 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.500 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.500 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.500 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 1 -- 172.21.15.29:0/1137134325 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb003ade0 con 0x7f0fc00b43d0 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 1 -- 172.21.15.29:0/1137134325 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0044630 con 0x7f0fc00b43d0 2024-04-09T12:05:27.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0faeffd640 10 monclient: dump: 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0fc4d2a640 5 monclient: authenticate success, global_id 4405 2024-04-09T12:05:27.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0fc4d2a640 10 monclient: _renew_subs 2024-04-09T12:05:27.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0fc4d2a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/1137134325 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc0143860 con 0x7f0fc00b43d0 2024-04-09T12:05:27.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0fbcd99640 4 set_mon_vals no callback set 2024-04-09T12:05:27.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0fc4d2a640 10 client.4405.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:27.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0fc4d2a640 10 monclient: _renew_subs 2024-04-09T12:05:27.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0fc4d2a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/1137134325 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc013e460 con 0x7f0fc00b43d0 2024-04-09T12:05:27.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.497+0000 7f0fc4d2a640 1 librados: init done 2024-04-09T12:05:27.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.498+0000 7f0fc4d2a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.498+0000 7f0fc4d2a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.498+0000 7f0fc4d2a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.498+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/1137134325 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc004e160 con 0x7f0fc00b43d0 2024-04-09T12:05:27.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.504+0000 7fbbb1947640 10 monclient: get_monmap_and_config 2024-04-09T12:05:27.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.504+0000 7fbbb1947640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.504+0000 7fbbb1947640 10 monclient: monmap: 2024-04-09T12:05:27.510 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.510 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.510 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:27.505516+0000 2024-04-09T12:05:27.510 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:27.505516+0000 2024-04-09T12:05:27.510 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.510 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.511 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:27.511 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:27.511 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:27.511 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:27.511 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:27.511 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.504+0000 7fbbb1947640 1 Processor -- start 2024-04-09T12:05:27.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.504+0000 7fbbb1947640 1 -- start start 2024-04-09T12:05:27.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.504+0000 7fbbb1947640 10 monclient: init 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 10 monclient: _add_conns ranks=[3,2,1,4,0] 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbbac0b43d0 0x7fbbac0a8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 10 monclient(hunting): picked mon.noname-a con 0x7fbbac0b43d0 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac13e970 0x7fbbac13edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 10 monclient(hunting): picked mon.noname-b con 0x7fbbac13e970 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbbac144c50 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac0aa750 con 0x7fbbac144c50 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac0a8e80 con 0x7fbbac0b43d0 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac0b47b0 con 0x7fbbac13e970 2024-04-09T12:05:27.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.505+0000 7fbbb1947640 10 monclient(hunting): authenticate will time out at 1393.625492s 2024-04-09T12:05:27.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.517+0000 7f0faeffd640 1 -- 172.21.15.29:0/1137134325 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0fb002f050 con 0x7f0fc00b43d0 2024-04-09T12:05:27.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.517+0000 7f0faeffd640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0fa006c590 0x7f0fa006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.518+0000 7f0fbdd9b640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0fa006c590 0x7f0fa006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.518+0000 7f0fbdd9b640 10 monclient: get_auth_request con 0x7f0fa006c590 auth_method 0 2024-04-09T12:05:27.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.518+0000 7f0faeffd640 10 client.4405.objecter ms_handle_connect 0x7f0fa006c590 2024-04-09T12:05:27.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.518+0000 7f0fbdd9b640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0fa006c590 0x7f0fa006ea50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0138ee0 tx=0x7f0fb4007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.519+0000 7f0faeffd640 1 -- 172.21.15.29:0/1137134325 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0fb007af30 con 0x7f0fc00b43d0 2024-04-09T12:05:27.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.519+0000 7f0faeffd640 10 client.4405.objecter ms_dispatch 0x7f0fc0000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:27.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.519+0000 7f0faeffd640 3 client.4405.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:27.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.519+0000 7f0faeffd640 3 client.4405.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:27.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.519+0000 7f0faeffd640 20 client.4405.objecter dump_active .. 0 homeless 2024-04-09T12:05:27.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.638+0000 7f62d37fe640 1 -- 172.21.15.29:0/493320257 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f62c4044900 con 0x7f62dc13eaa0 2024-04-09T12:05:27.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.639+0000 7f62d37fe640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f62bc06c5e0 0x7f62bc06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.639+0000 7f62dad9d640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f62bc06c5e0 0x7f62bc06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.639+0000 7f62dad9d640 10 monclient: get_auth_request con 0x7f62bc06c5e0 auth_method 0 2024-04-09T12:05:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.639+0000 7f00d77fe640 1 -- 172.21.15.29:0/2637682490 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f00d8058f10 con 0x7f00e013f1b0 2024-04-09T12:05:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.639+0000 7f00d77fe640 10 client.4328.objecter ms_dispatch 0x7f00e0000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.639+0000 7f00d77fe640 3 client.4328.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.639+0000 7f00d77fe640 3 client.4328.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.640+0000 7f00d77fe640 20 client.4328.objecter dump_active .. 0 homeless 2024-04-09T12:05:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.639+0000 7f62d37fe640 10 client.4338.objecter ms_handle_connect 0x7f62bc06c5e0 2024-04-09T12:05:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.639+0000 7f62dad9d640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f62bc06c5e0 0x7f62bc06eaa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62cc001560 tx=0x7f62cc007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.640+0000 7f00d77fe640 1 -- 172.21.15.29:0/2637682490 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f00d8054b50 con 0x7f00e013f1b0 2024-04-09T12:05:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.640+0000 7f00d77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.640+0000 7f00d77fe640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.642+0000 7fed4d7fa640 1 -- 172.21.15.29:0/3060002798 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed48017020 con 0x7fed50144c50 2024-04-09T12:05:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.642+0000 7fed4d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-09T12:05:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.642+0000 7fed4d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:27.646 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2024-04-09T12:05:27.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.644+0000 7fed56cdc640 10 librados: watch_flush enter 2024-04-09T12:05:27.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.644+0000 7fed56cdc640 10 librados: watch_flush exit 2024-04-09T12:05:27.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.644+0000 7fed56cdc640 20 client.4316.objecter shutdown clearing up homeless session... 2024-04-09T12:05:27.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.644+0000 7fed56cdc640 10 client.4316.objecter successfully canceled tick 2024-04-09T12:05:27.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.644+0000 7fed56cdc640 1 -- 172.21.15.29:0/3060002798 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fed3006c5c0 msgr2=0x7fed3006ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.644+0000 7fed56cdc640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fed3006c5c0 0x7fed3006ea80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed38036000 tx=0x7fed38030000 comp rx=0 tx=0).stop 2024-04-09T12:05:27.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.644+0000 7fed56cdc640 10 monclient: shutdown 2024-04-09T12:05:27.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.644+0000 7fed56cdc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:27.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.644+0000 7fed56cdc640 1 -- 172.21.15.29:0/3060002798 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed50144c50 msgr2=0x7fed500b74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.644+0000 7fed56cdc640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed50144c50 0x7fed500b74a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed4800ca80 tx=0x7fed4800cf40 comp rx=0 tx=0).stop 2024-04-09T12:05:27.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.645+0000 7fed56cdc640 1 -- 172.21.15.29:0/3060002798 shutdown_connections 2024-04-09T12:05:27.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.645+0000 7fed56cdc640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fed3006c5c0 0x7fed3006ea80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.645+0000 7fed56cdc640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fed50144c50 0x7fed500b74a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.645+0000 7fed56cdc640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed5013e970 0x7fed500b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.645+0000 7fed56cdc640 1 --2- 172.21.15.29:0/3060002798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed500b43d0 0x7fed50133b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.645+0000 7fed56cdc640 1 -- 172.21.15.29:0/3060002798 >> 172.21.15.29:0/3060002798 conn(0x7fed50065f30 msgr2=0x7fed5014c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:27.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.645+0000 7fed56cdc640 1 -- 172.21.15.29:0/3060002798 shutdown_connections 2024-04-09T12:05:27.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.645+0000 7fed56cdc640 1 -- 172.21.15.29:0/3060002798 wait complete. 2024-04-09T12:05:27.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.645+0000 7fed56cdc640 1 librados: shutdown 2024-04-09T12:05:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.645+0000 7fc387fff640 1 --2- 172.21.15.29:0/14244099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc388145360 0x7fc3880a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.646+0000 7fc387fff640 10 monclient(hunting): get_auth_request con 0x7fc388145360 auth_method 0 2024-04-09T12:05:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.647+0000 7fc387fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.647+0000 7fc387fff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.647+0000 7fc387fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.649+0000 7fc387fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.649+0000 7fc387fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.649+0000 7fc387fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.651+0000 7fbbaa7fc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac13e970 0x7fbbac13edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.652+0000 7fc387fff640 10 monclient(hunting): handle_auth_done global_id 4331 payload 274 2024-04-09T12:05:27.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.652+0000 7fc387fff640 1 -- 172.21.15.29:0/14244099 >> v1:172.21.15.173:6789/0 conn(0x7fc3880b43d0 legacy=0x7fc38813e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.653+0000 7fc387fff640 1 -- 172.21.15.29:0/14244099 >> v1:172.21.15.29:6789/0 conn(0x7fc38813f080 legacy=0x7fc388144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:27.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.653+0000 7fc387fff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.653+0000 7fc387fff640 1 monclient: found mon.noname-b 2024-04-09T12:05:27.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.653+0000 7fc387fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.653+0000 7fc387fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.653+0000 7fc387fff640 1 -- 172.21.15.29:0/14244099 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880a9580 con 0x7fc388145360 2024-04-09T12:05:27.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.653+0000 7f3c0f6ae640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-09T12:05:27.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.653+0000 7f3c0f6ae640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-09T12:05:27.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.653+0000 7f3c0f6ae640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.653+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3895368644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3c0804e160 con 0x7f3c0813f1b0 2024-04-09T12:05:27.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.655+0000 7fbbaa7fc640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac13e970 0x7fbbac13edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:56194/0 (socket says 172.21.15.29:56194) 2024-04-09T12:05:27.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.655+0000 7fbbaa7fc640 1 -- 172.21.15.29:0/1029372283 learned_addr learned my addr 172.21.15.29:0/1029372283 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:27.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.655+0000 7fbbaa7fc640 10 monclient(hunting): get_auth_request con 0x7fbbac13e970 auth_method 0 2024-04-09T12:05:27.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.655+0000 7fbbaa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.655+0000 7fbbaa7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.655+0000 7fbbaa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.657+0000 7fbbaa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.657+0000 7fbbaa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.657+0000 7fbbaa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-09T12:05:27.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7fbbaa7fc640 10 monclient(hunting): handle_auth_done global_id 4334 payload 274 2024-04-09T12:05:27.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7fbbaa7fc640 1 -- 172.21.15.29:0/1029372283 >> v2:172.21.15.29:3300/0 conn(0x7fbbac0b43d0 msgr2=0x7fbbac0a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:27.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7fbbaa7fc640 1 --2- 172.21.15.29:0/1029372283 >> v2:172.21.15.29:3300/0 conn(0x7fbbac0b43d0 0x7fbbac0a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7fbbaa7fc640 1 -- 172.21.15.29:0/1029372283 >> v1:172.21.15.173:6789/0 conn(0x7fbbac144c50 legacy=0x7fbbac1450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:27.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7fbbaa7fc640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7fbbaa7fc640 1 monclient: found mon.noname-b 2024-04-09T12:05:27.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7fbbaa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7fbbaa7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7fbbaa7fc640 1 -- 172.21.15.29:0/1029372283 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac0a9060 con 0x7fbbac13e970 2024-04-09T12:05:27.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7fc387fff640 1 --2- 172.21.15.29:0/14244099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc388145360 0x7fc3880a8940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc380009dc0 tx=0x7fc38002be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8825821c8c6e88ef server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7f62d37fe640 1 -- 172.21.15.29:0/493320257 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f62c402d040 con 0x7f62dc13eaa0 2024-04-09T12:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7f62d37fe640 10 client.4338.objecter ms_dispatch 0x7f62dc000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7f62d37fe640 3 client.4338.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7f62d37fe640 3 client.4338.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.660+0000 7f62d37fe640 20 client.4338.objecter dump_active .. 0 homeless 2024-04-09T12:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.661+0000 7f62d37fe640 1 -- 172.21.15.29:0/493320257 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f62c40772f0 con 0x7f62dc13eaa0 2024-04-09T12:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.661+0000 7f62d37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.661+0000 7f62d37fe640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:27.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.669+0000 7fbbaa7fc640 1 --2- 172.21.15.29:0/1029372283 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac13e970 0x7fbbac13edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009870 tx=0x7fbba002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=729169bf87274d9e server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 1 -- 172.21.15.29:0/14244099 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38002cc40 con 0x7fc388145360 2024-04-09T12:05:27.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:27.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 10 monclient: dump: 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 1 -- 172.21.15.29:0/14244099 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38002cda0 con 0x7fc388145360 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc38dc2a640 5 monclient: authenticate success, global_id 4331 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc38dc2a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc38dc2a640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 1 -- 172.21.15.29:0/14244099 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380034660 con 0x7fc388145360 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc38dc2a640 4 set_mon_vals no callback set 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.672+0000 7fc3867fc640 10 monclient: dump: 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.678 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.678 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.678 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.678 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.673+0000 7fc38dc2a640 10 monclient: shutdown 2024-04-09T12:05:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.673+0000 7fc38dc2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.673+0000 7fc38dc2a640 1 -- 172.21.15.29:0/14244099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc388145360 msgr2=0x7fc3880a8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.673+0000 7fc38dc2a640 1 --2- 172.21.15.29:0/14244099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc388145360 0x7fc3880a8940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc380009dc0 tx=0x7fc38002be90 comp rx=0 tx=0).stop 2024-04-09T12:05:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.673+0000 7fc38dc2a640 1 -- 172.21.15.29:0/14244099 shutdown_connections 2024-04-09T12:05:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.673+0000 7fc38dc2a640 1 --2- 172.21.15.29:0/14244099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc388145360 0x7fc3880a8940 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.673+0000 7fc38dc2a640 1 -- 172.21.15.29:0/14244099 >> 172.21.15.29:0/14244099 conn(0x7fc388065f30 msgr2=0x7fc388066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.673+0000 7fc38dc2a640 1 -- 172.21.15.29:0/14244099 shutdown_connections 2024-04-09T12:05:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.673+0000 7fc38dc2a640 1 -- 172.21.15.29:0/14244099 wait complete. 2024-04-09T12:05:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.674+0000 7fc38dc2a640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.674+0000 7fc38dc2a640 10 monclient: monmap: 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.674+0000 7fc38dc2a640 1 librados: starting msgr at 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.674+0000 7fc38dc2a640 1 librados: starting objecter 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.674+0000 7fc38dc2a640 1 Processor -- start 2024-04-09T12:05:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.674+0000 7fc38dc2a640 1 -- start start 2024-04-09T12:05:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.674+0000 7fc38dc2a640 1 librados: setting wanted keys 2024-04-09T12:05:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.674+0000 7fc38dc2a640 1 librados: calling monclient init 2024-04-09T12:05:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.674+0000 7fc38dc2a640 10 monclient: init 2024-04-09T12:05:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3880b43d0 0x7fc38813df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 10 monclient(hunting): picked mon.noname-b con 0x7fc3880b43d0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc38813f080 0x7fc388133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 10 monclient(hunting): picked mon.noname-a con 0x7fc38813f080 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc388145360 0x7fc3881442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 10 monclient(hunting): picked mon.noname-c con 0x7fc388145360 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc388138dd0 con 0x7fc38813f080 2024-04-09T12:05:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc388142bf0 con 0x7fc3880b43d0 2024-04-09T12:05:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc388143bb0 con 0x7fc388145360 2024-04-09T12:05:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.675+0000 7fc38dc2a640 10 monclient(hunting): authenticate will time out at 1393.795864s 2024-04-09T12:05:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 1 -- 172.21.15.29:0/1029372283 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0031640 con 0x7fbbac13e970 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 10 monclient: dump: 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.685 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 1 -- 172.21.15.29:0/1029372283 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba00317a0 con 0x7fbbac13e970 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbbb1947640 5 monclient: authenticate success, global_id 4334 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbbb1947640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbbb1947640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 1 -- 172.21.15.29:0/1029372283 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0031b30 con 0x7fbbac13e970 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbbb1947640 4 set_mon_vals no callback set 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.679+0000 7fbba9ffb640 10 monclient: dump: 2024-04-09T12:05:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.680+0000 7fbbb1947640 10 monclient: shutdown 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.680+0000 7fbbb1947640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.680+0000 7fbbb1947640 1 -- 172.21.15.29:0/1029372283 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac13e970 msgr2=0x7fbbac13edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.680+0000 7fbbb1947640 1 --2- 172.21.15.29:0/1029372283 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac13e970 0x7fbbac13edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009870 tx=0x7fbba002b8f0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.680+0000 7fbbb1947640 1 -- 172.21.15.29:0/1029372283 shutdown_connections 2024-04-09T12:05:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.680+0000 7fbbb1947640 1 --2- 172.21.15.29:0/1029372283 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac13e970 0x7fbbac13edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.680+0000 7fbbb1947640 1 --2- 172.21.15.29:0/1029372283 >> v2:172.21.15.29:3300/0 conn(0x7fbbac0b43d0 0x7fbbac0a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.680+0000 7fbbb1947640 1 -- 172.21.15.29:0/1029372283 >> 172.21.15.29:0/1029372283 conn(0x7fbbac065f30 msgr2=0x7fbbac066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.680+0000 7fbbb1947640 1 -- 172.21.15.29:0/1029372283 shutdown_connections 2024-04-09T12:05:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.680+0000 7fbbb1947640 1 -- 172.21.15.29:0/1029372283 wait complete. 2024-04-09T12:05:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.681+0000 7fc386ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc38813f080 0x7fc388133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.681+0000 7fbbb1947640 10 monclient: build_initial_monmap 2024-04-09T12:05:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.681+0000 7fbbb1947640 10 monclient: monmap: 2024-04-09T12:05:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.681+0000 7fbbb1947640 1 librados: starting msgr at 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.681+0000 7fbbb1947640 1 librados: starting objecter 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.681+0000 7fbbb1947640 1 Processor -- start 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 1 -- start start 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 1 librados: setting wanted keys 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 1 librados: calling monclient init 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 10 monclient: init 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:27.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbac0b43d0 0x7fbbac144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fc386ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc38813f080 0x7fc388133910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54344/0 (socket says 172.21.15.29:54344) 2024-04-09T12:05:27.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fc386ffd640 1 -- 172.21.15.29:0/2558520102 learned_addr learned my addr 172.21.15.29:0/2558520102 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:27.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fc386ffd640 10 monclient(hunting): get_auth_request con 0x7fc38813f080 auth_method 0 2024-04-09T12:05:27.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fc386ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fc386ffd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fc386ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 10 monclient(hunting): picked mon.noname-b con 0x7fbbac0b43d0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:27.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbac13e970 0x7fbbac1355c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 10 monclient(hunting): picked mon.noname-a con 0x7fbbac13e970 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac144c50 0x7fbbac1377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 10 monclient(hunting): picked mon.noname-c con 0x7fbbac144c50 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac135b00 con 0x7fbbac13e970 2024-04-09T12:05:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1373a0 con 0x7fbbac0b43d0 2024-04-09T12:05:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1437d0 con 0x7fbbac144c50 2024-04-09T12:05:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fbbb1947640 10 monclient(hunting): authenticate will time out at 1393.802701s 2024-04-09T12:05:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.682+0000 7fc387fff640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc388145360 0x7fc3881442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.683+0000 7fc386ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.683+0000 7fc386ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.683+0000 7fc386ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.683+0000 7fbbaa7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbac13e970 0x7fbbac1355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.687+0000 7fc386ffd640 10 monclient(hunting): handle_auth_done global_id 4341 payload 824 2024-04-09T12:05:27.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.687+0000 7fc386ffd640 1 -- 172.21.15.29:0/2558520102 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc388145360 msgr2=0x7fc3881442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.687+0000 7fc386ffd640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc388145360 0x7fc3881442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.687+0000 7fc386ffd640 1 -- 172.21.15.29:0/2558520102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3880b43d0 msgr2=0x7fc38813df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.687+0000 7fc386ffd640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3880b43d0 0x7fc38813df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.687+0000 7fc386ffd640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.687+0000 7fc386ffd640 1 monclient: found mon.noname-a 2024-04-09T12:05:27.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.687+0000 7fc386ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.687+0000 7fc386ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:27.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.687+0000 7fc386ffd640 1 -- 172.21.15.29:0/2558520102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc380009a70 con 0x7fc38813f080 2024-04-09T12:05:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.688+0000 7fbbaa7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbac13e970 0x7fbbac1355c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54360/0 (socket says 172.21.15.29:54360) 2024-04-09T12:05:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.688+0000 7fbbaa7fc640 1 -- 172.21.15.29:0/3767553964 learned_addr learned my addr 172.21.15.29:0/3767553964 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.688+0000 7fbbaa7fc640 10 monclient(hunting): get_auth_request con 0x7fbbac13e970 auth_method 0 2024-04-09T12:05:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.688+0000 7fbbaa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.688+0000 7fbbaa7fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.688+0000 7fbbaa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.692+0000 7fbbab7fe640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac144c50 0x7fbbac1377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.694+0000 7fbbab7fe640 10 monclient(hunting): get_auth_request con 0x7fbbac144c50 auth_method 0 2024-04-09T12:05:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.694+0000 7fbbab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.694+0000 7fbbab7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.694+0000 7fbbab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:27.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.695+0000 7fbbab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:27.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.695+0000 7fbbab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:27.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.695+0000 7fbbab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:27.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.700+0000 7fbbab7fe640 10 monclient(hunting): handle_auth_done global_id 4337 payload 824 2024-04-09T12:05:27.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.700+0000 7fbbab7fe640 1 -- 172.21.15.29:0/3767553964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbac0b43d0 msgr2=0x7fbbac144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.700+0000 7fbbab7fe640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbac0b43d0 0x7fbbac144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.700+0000 7fbbab7fe640 1 -- 172.21.15.29:0/3767553964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbac13e970 msgr2=0x7fbbac1355c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.700+0000 7fbbab7fe640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbac13e970 0x7fbbac1355c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.700+0000 7fbbab7fe640 10 monclient: _finish_hunting 0 2024-04-09T12:05:27.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.700+0000 7fbbab7fe640 1 monclient: found mon.noname-c 2024-04-09T12:05:27.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.700+0000 7fbbab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:27.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.700+0000 7fbbab7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.700+0000 7fbbab7fe640 1 -- 172.21.15.29:0/3767553964 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00094d0 con 0x7fbbac144c50 2024-04-09T12:05:27.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.703+0000 7fbbab7fe640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac144c50 0x7fbbac1377c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbba400be50 tx=0x7fbba400bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.703+0000 7fbb93fff640 10 client.?.objecter ms_handle_connect 0x7fbbac144c50 2024-04-09T12:05:27.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.703+0000 7fbb93fff640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:27.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.746+0000 7fc386ffd640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc38813f080 0x7fc388133910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c410 tx=0x7fc37c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.746+0000 7fc36ffff640 10 client.?.objecter ms_handle_connect 0x7fc38813f080 2024-04-09T12:05:27.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.746+0000 7fc36ffff640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.755+0000 7f0faeffd640 1 -- 172.21.15.29:0/1137134325 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f0fb0076b70 con 0x7f0fc00b43d0 2024-04-09T12:05:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.755+0000 7f0faeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.755+0000 7f0faeffd640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:27.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 1 -- 172.21.15.29:0/2558520102 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c0035f0 con 0x7fc38813f080 2024-04-09T12:05:27.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:27.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 10 monclient: dump: 2024-04-09T12:05:27.762 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 1 -- 172.21.15.29:0/2558520102 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c003750 con 0x7fc38813f080 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 1 -- 172.21.15.29:0/2558520102 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c003b40 con 0x7fc38813f080 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc36ffff640 10 monclient: dump: 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc38dc2a640 5 monclient: authenticate success, global_id 4341 2024-04-09T12:05:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc38dc2a640 10 monclient: _renew_subs 2024-04-09T12:05:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc38dc2a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc38dc2a640 1 -- 172.21.15.29:0/2558520102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc388143e90 con 0x7fc38813f080 2024-04-09T12:05:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc385ffb640 4 set_mon_vals no callback set 2024-04-09T12:05:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc38dc2a640 10 client.4341.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc38dc2a640 10 monclient: _renew_subs 2024-04-09T12:05:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc38dc2a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc38dc2a640 1 -- 172.21.15.29:0/2558520102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3881447f0 con 0x7fc38813f080 2024-04-09T12:05:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.759+0000 7fc38dc2a640 1 librados: init done 2024-04-09T12:05:27.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.760+0000 7fc38dc2a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.760+0000 7fc38dc2a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.760+0000 7fc38dc2a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:27.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.760+0000 7fc38dc2a640 1 -- 172.21.15.29:0/2558520102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38804e160 con 0x7fc38813f080 2024-04-09T12:05:27.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 1 -- 172.21.15.29:0/3767553964 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4014440 con 0x7fbbac144c50 2024-04-09T12:05:27.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:27.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 10 monclient: dump: 2024-04-09T12:05:27.769 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.769 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.769 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 10 monclient: _finish_auth 0 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 10 monclient: _check_auth_tickets 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 1 -- 172.21.15.29:0/3767553964 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba40145a0 con 0x7fbbac144c50 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:27.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 1 -- 172.21.15.29:0/3767553964 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4014950 con 0x7fbbac144c50 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbb93fff640 10 monclient: dump: 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:27.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbbb1947640 5 monclient: authenticate success, global_id 4337 2024-04-09T12:05:27.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbbb1947640 10 monclient: _renew_subs 2024-04-09T12:05:27.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbbb1947640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbbb1947640 1 -- 172.21.15.29:0/3767553964 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac0b6790 con 0x7fbbac144c50 2024-04-09T12:05:27.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbba97fa640 4 set_mon_vals no callback set 2024-04-09T12:05:27.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbbb1947640 10 client.4337.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:27.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbbb1947640 10 monclient: _renew_subs 2024-04-09T12:05:27.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbbb1947640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbbb1947640 1 -- 172.21.15.29:0/3767553964 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac137d00 con 0x7fbbac144c50 2024-04-09T12:05:27.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.766+0000 7fbbb1947640 1 librados: init done 2024-04-09T12:05:27.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.767+0000 7fbbb1947640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.767+0000 7fbbb1947640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:27.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.767+0000 7fbbb1947640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.767+0000 7fbbb1947640 1 -- 172.21.15.29:0/3767553964 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac135c80 con 0x7fbbac144c50 2024-04-09T12:05:27.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.786+0000 7fc36ffff640 1 -- 172.21.15.29:0/2558520102 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc37c003ca0 con 0x7fc38813f080 2024-04-09T12:05:27.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.787+0000 7fc36ffff640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc37406c5c0 0x7fc37406ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.787+0000 7fc3877fe640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc37406c5c0 0x7fc37406ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.787+0000 7fc3877fe640 10 monclient: get_auth_request con 0x7fc37406c5c0 auth_method 0 2024-04-09T12:05:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.787+0000 7fc36ffff640 10 client.4341.objecter ms_handle_connect 0x7fc37406c5c0 2024-04-09T12:05:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.787+0000 7fc3877fe640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc37406c5c0 0x7fc37406ea80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc3780015f0 tx=0x7fc378007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.850+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3895368644 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c00017090 con 0x7f3c0813f1b0 2024-04-09T12:05:27.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.850+0000 7f3bfdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-09T12:05:27.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.850+0000 7f3bfdffb640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:27.854 INFO:teuthology.orchestra.run.smithi029.stdout:90194313223 2024-04-09T12:05:27.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.853+0000 7f3c0f6ae640 10 librados: watch_flush enter 2024-04-09T12:05:27.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.853+0000 7f3c0f6ae640 10 librados: watch_flush exit 2024-04-09T12:05:27.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.853+0000 7f3c0f6ae640 20 client.4399.objecter shutdown clearing up homeless session... 2024-04-09T12:05:27.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.853+0000 7f3c0f6ae640 10 client.4399.objecter successfully canceled tick 2024-04-09T12:05:27.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.853+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3895368644 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3bec06c610 msgr2=0x7f3bec06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3bec06c610 0x7f3bec06ead0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c04036000 tx=0x7f3c0403c040 comp rx=0 tx=0).stop 2024-04-09T12:05:27.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 10 monclient: shutdown 2024-04-09T12:05:27.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:27.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3895368644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0813f1b0 msgr2=0x7f3c08130e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0813f1b0 0x7f3c08130e90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000ca70 tx=0x7f3c0000ce70 comp rx=0 tx=0).stop 2024-04-09T12:05:27.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3895368644 shutdown_connections 2024-04-09T12:05:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f3bec06c610 0x7f3bec06ead0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0813f1b0 0x7f3c08130e90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3c080b7b10 0x7f3c081da570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 --2- 172.21.15.29:0/3895368644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c080a8f10 0x7f3c08140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3895368644 >> 172.21.15.29:0/3895368644 conn(0x7f3c08066140 msgr2=0x7f3c0813ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3895368644 shutdown_connections 2024-04-09T12:05:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 -- 172.21.15.29:0/3895368644 wait complete. 2024-04-09T12:05:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.854+0000 7f3c0f6ae640 1 librados: shutdown 2024-04-09T12:05:27.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313224 got 90194313223 for osd.1 2024-04-09T12:05:27.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.884+0000 7f00e5177640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-09T12:05:27.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.884+0000 7f00e5177640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-09T12:05:27.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.884+0000 7f00e5177640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:27.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.884+0000 7f00e5177640 1 -- 172.21.15.29:0/2637682490 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f00e00ab7e0 con 0x7f00e013f1b0 2024-04-09T12:05:27.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.898+0000 7fbb93fff640 1 -- 172.21.15.29:0/3767553964 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbba4003970 con 0x7fbbac144c50 2024-04-09T12:05:27.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.898+0000 7fbb93fff640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fbb9806c5c0 0x7fbb9806ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:27.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.898+0000 7fbbaaffd640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fbb9806c5c0 0x7fbb9806ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:27.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.899+0000 7fbbaaffd640 10 monclient: get_auth_request con 0x7fbb9806c5c0 auth_method 0 2024-04-09T12:05:27.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.899+0000 7fbb93fff640 10 client.4337.objecter ms_handle_connect 0x7fbb9806c5c0 2024-04-09T12:05:27.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.899+0000 7fbbaaffd640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fbb9806c5c0 0x7fbb9806ea80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009710 tx=0x7fbb9c006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:27.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.935+0000 7f62e114e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2024-04-09T12:05:27.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.935+0000 7f62e114e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-04-09T12:05:27.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.935+0000 7f62e114e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:27.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.935+0000 7f62e114e640 1 -- 172.21.15.29:0/493320257 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f62dc0b2ec0 con 0x7f62dc13eaa0 2024-04-09T12:05:27.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.986+0000 7f0fc4d2a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-09T12:05:27.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.986+0000 7f0fc4d2a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-09T12:05:27.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.986+0000 7f0fc4d2a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:27.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.986+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/1137134325 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0fc00706d0 con 0x7f0fc00b43d0 2024-04-09T12:05:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.990+0000 7f0faeffd640 1 -- 172.21.15.29:0/1137134325 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fb003b050 con 0x7f0fc00b43d0 2024-04-09T12:05:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.990+0000 7f0faeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-09T12:05:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.990+0000 7f0faeffd640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:27.993 INFO:teuthology.orchestra.run.smithi029.stdout:60129542148 2024-04-09T12:05:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 10 librados: watch_flush enter 2024-04-09T12:05:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 10 librados: watch_flush exit 2024-04-09T12:05:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 20 client.4405.objecter shutdown clearing up homeless session... 2024-04-09T12:05:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 10 client.4405.objecter successfully canceled tick 2024-04-09T12:05:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/1137134325 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0fa006c590 msgr2=0x7f0fa006ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0fa006c590 0x7f0fa006ea50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0138ee0 tx=0x7f0fb4007990 comp rx=0 tx=0).stop 2024-04-09T12:05:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 10 monclient: shutdown 2024-04-09T12:05:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/1137134325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc00b43d0 msgr2=0x7f0fc01328a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc00b43d0 0x7f0fc01328a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00098a0 tx=0x7f0fb00046c0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/1137134325 shutdown_connections 2024-04-09T12:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f0fa006c590 0x7f0fa006ea50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0fc0144c50 0x7f0fc00b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fc013e970 0x7f0fc00b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 --2- 172.21.15.29:0/1137134325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc00b43d0 0x7f0fc01328a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/1137134325 >> 172.21.15.29:0/1137134325 conn(0x7f0fc0065f30 msgr2=0x7f0fc013edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/1137134325 shutdown_connections 2024-04-09T12:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 -- 172.21.15.29:0/1137134325 wait complete. 2024-04-09T12:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:27.992+0000 7f0fc4d2a640 1 librados: shutdown 2024-04-09T12:05:28.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.0 2024-04-09T12:05:28.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.013+0000 7fbb93fff640 1 -- 172.21.15.29:0/3767553964 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbba4058bd0 con 0x7fbbac144c50 2024-04-09T12:05:28.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.013+0000 7fbb93fff640 10 client.4337.objecter ms_dispatch 0x7fbbac000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:28.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.013+0000 7fbb93fff640 3 client.4337.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:28.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.013+0000 7fbb93fff640 3 client.4337.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:28.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.013+0000 7fbb93fff640 20 client.4337.objecter dump_active .. 0 homeless 2024-04-09T12:05:28.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.076+0000 7fbb93fff640 1 -- 172.21.15.29:0/3767553964 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fbba4054810 con 0x7fbbac144c50 2024-04-09T12:05:28.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.076+0000 7fbb93fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:28.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.076+0000 7fbb93fff640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:28.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.077+0000 7f00d77fe640 1 -- 172.21.15.29:0/2637682490 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00e00ab7e0 con 0x7f00e013f1b0 2024-04-09T12:05:28.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.077+0000 7f00d77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-09T12:05:28.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.077+0000 7f00d77fe640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:28.080 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2024-04-09T12:05:28.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 10 librados: watch_flush enter 2024-04-09T12:05:28.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 10 librados: watch_flush exit 2024-04-09T12:05:28.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 20 client.4328.objecter shutdown clearing up homeless session... 2024-04-09T12:05:28.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 10 client.4328.objecter successfully canceled tick 2024-04-09T12:05:28.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 -- 172.21.15.29:0/2637682490 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f00c006c5c0 msgr2=0x7f00c006ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f00c006c5c0 0x7f00c006ea80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00d0036000 tx=0x7f00d0030000 comp rx=0 tx=0).stop 2024-04-09T12:05:28.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 10 monclient: shutdown 2024-04-09T12:05:28.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:28.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 -- 172.21.15.29:0/2637682490 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e013f1b0 msgr2=0x7f00e006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e013f1b0 0x7f00e006d3d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f00d800b410 tx=0x7f00d800b8d0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 -- 172.21.15.29:0/2637682490 shutdown_connections 2024-04-09T12:05:28.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f00c006c5c0 0x7f00c006ea80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00e013f1b0 0x7f00e006d3d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e00b7b10 0x7f00e00ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 --2- 172.21.15.29:0/2637682490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e00a8f10 0x7f00e00aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 -- 172.21.15.29:0/2637682490 >> 172.21.15.29:0/2637682490 conn(0x7f00e0066140 msgr2=0x7f00e0144800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:28.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 -- 172.21.15.29:0/2637682490 shutdown_connections 2024-04-09T12:05:28.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 -- 172.21.15.29:0/2637682490 wait complete. 2024-04-09T12:05:28.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.080+0000 7f00e5177640 1 librados: shutdown 2024-04-09T12:05:28.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-09T12:05:28.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.137+0000 7fc36ffff640 1 -- 172.21.15.29:0/2558520102 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc37c057cc0 con 0x7fc38813f080 2024-04-09T12:05:28.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.137+0000 7fc36ffff640 10 client.4341.objecter ms_dispatch 0x7fc388000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:28.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.137+0000 7fc36ffff640 3 client.4341.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:28.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.137+0000 7fc36ffff640 3 client.4341.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:28.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.137+0000 7fc36ffff640 20 client.4341.objecter dump_active .. 0 homeless 2024-04-09T12:05:28.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.137+0000 7fc36ffff640 1 -- 172.21.15.29:0/2558520102 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fc37c053900 con 0x7fc38813f080 2024-04-09T12:05:28.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.137+0000 7fc36ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:28.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.137+0000 7fc36ffff640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:28.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.220+0000 7f62d37fe640 1 -- 172.21.15.29:0/493320257 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62c4052090 con 0x7f62dc13eaa0 2024-04-09T12:05:28.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.220+0000 7f62d37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-04-09T12:05:28.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.220+0000 7f62d37fe640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:28.223 INFO:teuthology.orchestra.run.smithi029.stdout:81604378633 2024-04-09T12:05:28.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 10 librados: watch_flush enter 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 10 librados: watch_flush exit 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 20 client.4338.objecter shutdown clearing up homeless session... 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 10 client.4338.objecter successfully canceled tick 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 1 -- 172.21.15.29:0/493320257 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f62bc06c5e0 msgr2=0x7f62bc06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f62bc06c5e0 0x7f62bc06eaa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62cc001560 tx=0x7f62cc007990 comp rx=0 tx=0).stop 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 10 monclient: shutdown 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 1 -- 172.21.15.29:0/493320257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62dc13eaa0 msgr2=0x7f62dc1de530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62dc13eaa0 0x7f62dc1de530 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f62c402bf20 tx=0x7f62c40046c0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 1 -- 172.21.15.29:0/493320257 shutdown_connections 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f62bc06c5e0 0x7f62bc06eaa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62dc144d60 0x7f62dc1dea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62dc13eaa0 0x7f62dc1de530 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 1 --2- 172.21.15.29:0/493320257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62dc0b7b10 0x7f62dc138ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.222+0000 7f62e114e640 1 -- 172.21.15.29:0/493320257 >> 172.21.15.29:0/493320257 conn(0x7f62dc066140 msgr2=0x7f62dc0b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:28.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.223+0000 7f62e114e640 1 -- 172.21.15.29:0/493320257 shutdown_connections 2024-04-09T12:05:28.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.223+0000 7f62e114e640 1 -- 172.21.15.29:0/493320257 wait complete. 2024-04-09T12:05:28.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.223+0000 7f62e114e640 1 librados: shutdown 2024-04-09T12:05:28.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 81604378633 got 81604378633 for osd.7 2024-04-09T12:05:28.236 DEBUG:teuthology.parallel:result is None 2024-04-09T12:05:28.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.313+0000 7fbbb1947640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-09T12:05:28.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.313+0000 7fbbb1947640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-09T12:05:28.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.313+0000 7fbbb1947640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:28.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.313+0000 7fbbb1947640 1 -- 172.21.15.29:0/3767553964 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbbac04e160 con 0x7fbbac144c50 2024-04-09T12:05:28.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.317+0000 7fbb93fff640 1 -- 172.21.15.29:0/3767553964 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbba4019070 con 0x7fbbac144c50 2024-04-09T12:05:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.317+0000 7fbb93fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-09T12:05:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.317+0000 7fbb93fff640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:28.320 INFO:teuthology.orchestra.run.smithi029.stdout:85899345930 2024-04-09T12:05:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 10 librados: watch_flush enter 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 10 librados: watch_flush exit 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 20 client.4337.objecter shutdown clearing up homeless session... 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 10 client.4337.objecter successfully canceled tick 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 -- 172.21.15.29:0/3767553964 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fbb9806c5c0 msgr2=0x7fbb9806ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fbb9806c5c0 0x7fbb9806ea80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009710 tx=0x7fbb9c006c90 comp rx=0 tx=0).stop 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 10 monclient: shutdown 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 -- 172.21.15.29:0/3767553964 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac144c50 msgr2=0x7fbbac1377c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac144c50 0x7fbbac1377c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbba400be50 tx=0x7fbba400bf40 comp rx=0 tx=0).stop 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 -- 172.21.15.29:0/3767553964 shutdown_connections 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fbb9806c5c0 0x7fbb9806ea80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbac144c50 0x7fbbac1377c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbac13e970 0x7fbbac1355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 --2- 172.21.15.29:0/3767553964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbac0b43d0 0x7fbbac144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 -- 172.21.15.29:0/3767553964 >> 172.21.15.29:0/3767553964 conn(0x7fbbac065f30 msgr2=0x7fbbac0b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:28.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 -- 172.21.15.29:0/3767553964 shutdown_connections 2024-04-09T12:05:28.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 -- 172.21.15.29:0/3767553964 wait complete. 2024-04-09T12:05:28.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.319+0000 7fbbb1947640 1 librados: shutdown 2024-04-09T12:05:28.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 85899345930 got 85899345930 for osd.4 2024-04-09T12:05:28.333 DEBUG:teuthology.parallel:result is None 2024-04-09T12:05:28.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.367+0000 7fc38dc2a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-09T12:05:28.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.367+0000 7fc38dc2a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-09T12:05:28.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.367+0000 7fc38dc2a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:28.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.367+0000 7fc38dc2a640 1 -- 172.21.15.29:0/2558520102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc388142d60 con 0x7fc38813f080 2024-04-09T12:05:28.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.370+0000 7fc36ffff640 1 -- 172.21.15.29:0/2558520102 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc388142d60 con 0x7fc38813f080 2024-04-09T12:05:28.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.370+0000 7fc36ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-09T12:05:28.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.370+0000 7fc36ffff640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:28.373 INFO:teuthology.orchestra.run.smithi029.stdout:64424509447 2024-04-09T12:05:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 10 librados: watch_flush enter 2024-04-09T12:05:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 10 librados: watch_flush exit 2024-04-09T12:05:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 20 client.4341.objecter shutdown clearing up homeless session... 2024-04-09T12:05:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 10 client.4341.objecter successfully canceled tick 2024-04-09T12:05:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 -- 172.21.15.29:0/2558520102 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc37406c5c0 msgr2=0x7fc37406ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc37406c5c0 0x7fc37406ea80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc3780015f0 tx=0x7fc378007a40 comp rx=0 tx=0).stop 2024-04-09T12:05:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 10 monclient: shutdown 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 -- 172.21.15.29:0/2558520102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc38813f080 msgr2=0x7fc388133910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc38813f080 0x7fc388133910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c410 tx=0x7fc37c00c8d0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 -- 172.21.15.29:0/2558520102 shutdown_connections 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc37406c5c0 0x7fc37406ea80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc388145360 0x7fc3881442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc38813f080 0x7fc388133910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 --2- 172.21.15.29:0/2558520102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3880b43d0 0x7fc38813df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 -- 172.21.15.29:0/2558520102 >> 172.21.15.29:0/2558520102 conn(0x7fc388065f30 msgr2=0x7fc3880b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 -- 172.21.15.29:0/2558520102 shutdown_connections 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 -- 172.21.15.29:0/2558520102 wait complete. 2024-04-09T12:05:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.372+0000 7fc38dc2a640 1 librados: shutdown 2024-04-09T12:05:28.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-04-09T12:05:28.386 DEBUG:teuthology.parallel:result is None 2024-04-09T12:05:28.474 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-09T12:05:28.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.577+0000 7f137dc05640 10 monclient: get_monmap_and_config 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.577+0000 7f137dc05640 10 monclient: build_initial_monmap 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.577+0000 7f137dc05640 10 monclient: monmap: 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:28.578654+0000 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:28.578654+0000 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:28.581 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.577+0000 7f137dc05640 1 Processor -- start 2024-04-09T12:05:28.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.577+0000 7f137dc05640 1 -- start start 2024-04-09T12:05:28.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.577+0000 7f137dc05640 10 monclient: init 2024-04-09T12:05:28.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:28.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2024-04-09T12:05:28.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f13780b7b10 0x7f13780a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 10 monclient(hunting): picked mon.noname-c con 0x7f13780b7b10 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f13780a8f10 0x7f137813eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 10 monclient(hunting): picked mon.noname-b con 0x7f13780a8f10 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f137813efe0 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780aa840 con 0x7f137813efe0 2024-04-09T12:05:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137813f470 con 0x7f13780b7b10 2024-04-09T12:05:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780b7ef0 con 0x7f13780a8f10 2024-04-09T12:05:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.578+0000 7f137dc05640 10 monclient(hunting): authenticate will time out at 1394.698493s 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f1376ffd640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f13780a8f10 0x7f137813eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f1377fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f137813efe0 0x7f1378144d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33102/0 (socket says 172.21.15.29:33102) 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f1377fff640 1 -- 172.21.15.29:0/3063653421 learned_addr learned my addr 172.21.15.29:0/3063653421 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f13777fe640 1 --2- 172.21.15.29:0/3063653421 >> v2:172.21.15.173:3300/0 conn(0x7f13780b7b10 0x7f13780a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f1376ffd640 10 monclient(hunting): get_auth_request con 0x7f13780a8f10 auth_method 0 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f1376ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f1376ffd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f1376ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f13777fe640 10 monclient(hunting): get_auth_request con 0x7f13780b7b10 auth_method 0 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f13777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f13777fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.579+0000 7f13777fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.580+0000 7f1376ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:28.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.580+0000 7f1376ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:28.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.580+0000 7f1376ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:28.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.580+0000 7f13777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:28.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.580+0000 7f13777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:28.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.580+0000 7f13777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:28.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f13767fc640 1 -- 172.21.15.29:0/3063653421 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965917835 0 0) 0x7f13780aa840 con 0x7f137813efe0 2024-04-09T12:05:28.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f13767fc640 10 monclient(hunting): _negotiate 2024-04-09T12:05:28.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f13767fc640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f13767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f13767fc640 10 monclient(hunting): my global_id is 4347 2024-04-09T12:05:28.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f13767fc640 1 -- 172.21.15.29:0/3063653421 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1360003520 con 0x7f137813efe0 2024-04-09T12:05:28.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f1376ffd640 10 monclient(hunting): handle_auth_done global_id 4340 payload 274 2024-04-09T12:05:28.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f1376ffd640 1 -- 172.21.15.29:0/3063653421 >> v2:172.21.15.173:3300/0 conn(0x7f13780b7b10 msgr2=0x7f13780a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:28.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f1376ffd640 1 --2- 172.21.15.29:0/3063653421 >> v2:172.21.15.173:3300/0 conn(0x7f13780b7b10 0x7f13780a89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f1376ffd640 1 -- 172.21.15.29:0/3063653421 >> v1:172.21.15.29:6789/0 conn(0x7f137813efe0 legacy=0x7f1378144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f1376ffd640 10 monclient: _finish_hunting 0 2024-04-09T12:05:28.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f1376ffd640 1 monclient: found mon.noname-b 2024-04-09T12:05:28.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f1376ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:28.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f1376ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:28.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f1376ffd640 1 -- 172.21.15.29:0/3063653421 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780a93c0 con 0x7f13780a8f10 2024-04-09T12:05:28.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.581+0000 7f13777fe640 1 --2- 172.21.15.29:0/3063653421 >> v2:172.21.15.173:3300/0 conn(0x7f13780b7b10 0x7f13780a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-09T12:05:28.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.584+0000 7f1376ffd640 1 --2- 172.21.15.29:0/3063653421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f13780a8f10 0x7f137813eaa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097a0 tx=0x7f136c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf31249e69f4829f server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:28.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 1 -- 172.21.15.29:0/3063653421 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c031830 con 0x7f13780a8f10 2024-04-09T12:05:28.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:28.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:28.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 10 monclient: dump: 2024-04-09T12:05:28.591 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:28.591 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 10 monclient: _finish_auth 0 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 10 monclient: _check_auth_tickets 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 1 -- 172.21.15.29:0/3063653421 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c031990 con 0x7f13780a8f10 2024-04-09T12:05:28.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f137dc05640 5 monclient: authenticate success, global_id 4340 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 1 -- 172.21.15.29:0/3063653421 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c031d20 con 0x7f13780a8f10 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f13767fc640 10 monclient: dump: 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:28.593 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f137dc05640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.587+0000 7f137dc05640 4 set_mon_vals no callback set 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.588+0000 7f137dc05640 10 monclient: shutdown 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.588+0000 7f137dc05640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.588+0000 7f137dc05640 1 -- 172.21.15.29:0/3063653421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f13780a8f10 msgr2=0x7f137813eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.588+0000 7f137dc05640 1 --2- 172.21.15.29:0/3063653421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f13780a8f10 0x7f137813eaa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097a0 tx=0x7f136c02b8d0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.588+0000 7f137dc05640 1 -- 172.21.15.29:0/3063653421 shutdown_connections 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.588+0000 7f137dc05640 1 --2- 172.21.15.29:0/3063653421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f13780a8f10 0x7f137813eaa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.588+0000 7f137dc05640 1 --2- 172.21.15.29:0/3063653421 >> v2:172.21.15.173:3300/0 conn(0x7f13780b7b10 0x7f13780a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.588+0000 7f137dc05640 1 -- 172.21.15.29:0/3063653421 >> 172.21.15.29:0/3063653421 conn(0x7f1378066140 msgr2=0x7f13780b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.588+0000 7f137dc05640 1 -- 172.21.15.29:0/3063653421 shutdown_connections 2024-04-09T12:05:28.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.588+0000 7f137dc05640 1 -- 172.21.15.29:0/3063653421 wait complete. 2024-04-09T12:05:28.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.589+0000 7f137dc05640 10 monclient: build_initial_monmap 2024-04-09T12:05:28.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.589+0000 7f137dc05640 10 monclient: monmap: 2024-04-09T12:05:28.598 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:28.598 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:28.598 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:28.598 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:28.598 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:28.598 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.598 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:28.598 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.589+0000 7f137dc05640 1 librados: starting msgr at 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.589+0000 7f137dc05640 1 librados: starting objecter 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.589+0000 7f137dc05640 1 Processor -- start 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.589+0000 7f137dc05640 1 -- start start 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.589+0000 7f137dc05640 1 librados: setting wanted keys 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.589+0000 7f137dc05640 1 librados: calling monclient init 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.589+0000 7f137dc05640 10 monclient: init 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13780a8f10 0x7f13780b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 10 monclient(hunting): picked mon.noname-b con 0x7f13780a8f10 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13780b7b10 0x7f13781da080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 10 monclient(hunting): picked mon.noname-a con 0x7f13780b7b10 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f137813efe0 0x7f137813a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 10 monclient(hunting): picked mon.noname-c con 0x7f137813efe0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1378139ce0 con 0x7f13780b7b10 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1378139f80 con 0x7f13780a8f10 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780b6f80 con 0x7f137813efe0 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f137dc05640 10 monclient(hunting): authenticate will time out at 1394.710391s 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.590+0000 7f1377fff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f137813efe0 0x7f137813a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1376ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13780b7b10 0x7f13781da080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f13777fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13780a8f10 0x7f13780b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1377fff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f137813efe0 0x7f137813a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:56238/0 (socket says 172.21.15.29:56238) 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1377fff640 1 -- 172.21.15.29:0/3629561480 learned_addr learned my addr 172.21.15.29:0/3629561480 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1377fff640 10 monclient(hunting): get_auth_request con 0x7f137813efe0 auth_method 0 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1377fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1377fff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1377fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1376ffd640 10 monclient(hunting): get_auth_request con 0x7f13780b7b10 auth_method 0 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1376ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1376ffd640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1376ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f13777fe640 10 monclient(hunting): get_auth_request con 0x7f13780a8f10 auth_method 0 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f13777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f13777fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f13777fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1377fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1377fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1377fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f13777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f13777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f13777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1376ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1376ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.591+0000 7f1376ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.594+0000 7f13777fe640 10 monclient(hunting): handle_auth_done global_id 4411 payload 824 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.594+0000 7f13777fe640 1 -- 172.21.15.29:0/3629561480 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f137813efe0 msgr2=0x7f137813a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.594+0000 7f13777fe640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f137813efe0 0x7f137813a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.594+0000 7f13777fe640 1 -- 172.21.15.29:0/3629561480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13780b7b10 msgr2=0x7f13781da080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.594+0000 7f13777fe640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13780b7b10 0x7f13781da080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.594+0000 7f13777fe640 10 monclient: _finish_hunting 0 2024-04-09T12:05:28.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.594+0000 7f13777fe640 1 monclient: found mon.noname-b 2024-04-09T12:05:28.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.594+0000 7f13777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:28.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.594+0000 7f13777fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:28.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.594+0000 7f13777fe640 1 -- 172.21.15.29:0/3629561480 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368009400 con 0x7f13780a8f10 2024-04-09T12:05:28.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.596+0000 7f13777fe640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13780a8f10 0x7f13780b4d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f136800e900 tx=0x7f136800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:28.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.596+0000 7f135ffff640 10 client.?.objecter ms_handle_connect 0x7f13780a8f10 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.596+0000 7f135ffff640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 1 -- 172.21.15.29:0/3629561480 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136800ca00 con 0x7f13780a8f10 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 10 monclient: dump: 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:28.605 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 10 monclient: _finish_auth 0 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 10 monclient: _check_auth_tickets 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 1 -- 172.21.15.29:0/3629561480 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136800cb60 con 0x7f13780a8f10 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 1 -- 172.21.15.29:0/3629561480 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368013470 con 0x7f13780a8f10 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f135ffff640 10 monclient: dump: 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.607 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:28.607 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.607 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:28.607 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:28.607 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:28.607 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f137dc05640 5 monclient: authenticate success, global_id 4411 2024-04-09T12:05:28.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f137dc05640 10 monclient: _renew_subs 2024-04-09T12:05:28.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f137dc05640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:28.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f1375ffb640 4 set_mon_vals no callback set 2024-04-09T12:05:28.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f137dc05640 1 -- 172.21.15.29:0/3629561480 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c009400 con 0x7f13780a8f10 2024-04-09T12:05:28.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f137dc05640 10 client.4411.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:28.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f137dc05640 10 monclient: _renew_subs 2024-04-09T12:05:28.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f137dc05640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:28.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f137dc05640 1 -- 172.21.15.29:0/3629561480 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1378139ae0 con 0x7f13780a8f10 2024-04-09T12:05:28.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.600+0000 7f137dc05640 1 librados: init done 2024-04-09T12:05:28.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.601+0000 7f137dc05640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:28.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.601+0000 7f137dc05640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:28.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.601+0000 7f137dc05640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:28.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.601+0000 7f137dc05640 1 -- 172.21.15.29:0/3629561480 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137804e160 con 0x7f13780a8f10 2024-04-09T12:05:28.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.620+0000 7f135ffff640 1 -- 172.21.15.29:0/3629561480 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f13680135d0 con 0x7f13780a8f10 2024-04-09T12:05:28.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.620+0000 7f135ffff640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f136406c5e0 0x7f136406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.620+0000 7f1376ffd640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f136406c5e0 0x7f136406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.621+0000 7f1376ffd640 10 monclient: get_auth_request con 0x7f136406c5e0 auth_method 0 2024-04-09T12:05:28.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.621+0000 7f1376ffd640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f136406c5e0 0x7f136406eaa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f136c036000 tx=0x7f136c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:28.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.621+0000 7f135ffff640 10 client.4411.objecter ms_handle_connect 0x7f136406c5e0 2024-04-09T12:05:28.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.623+0000 7f135ffff640 1 -- 172.21.15.29:0/3629561480 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1368058be0 con 0x7f13780a8f10 2024-04-09T12:05:28.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.623+0000 7f135ffff640 10 client.4411.objecter ms_dispatch 0x7f1378000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:28.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.623+0000 7f135ffff640 3 client.4411.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:28.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.623+0000 7f135ffff640 3 client.4411.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:28.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.623+0000 7f135ffff640 20 client.4411.objecter dump_active .. 0 homeless 2024-04-09T12:05:28.663 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-09T12:05:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.762+0000 7fc5805dd640 10 monclient: get_monmap_and_config 2024-04-09T12:05:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.762+0000 7fc5805dd640 10 monclient: build_initial_monmap 2024-04-09T12:05:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.762+0000 7fc5805dd640 10 monclient: monmap: 2024-04-09T12:05:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:28.764313+0000 2024-04-09T12:05:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:28.764313+0000 2024-04-09T12:05:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:28.768 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:28.768 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.763+0000 7fc5805dd640 1 Processor -- start 2024-04-09T12:05:28.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.763+0000 7fc5805dd640 1 -- start start 2024-04-09T12:05:28.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.763+0000 7fc5805dd640 10 monclient: init 2024-04-09T12:05:28.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:28.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2024-04-09T12:05:28.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc57806a7f0 0x7fc5780af960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 10 monclient(hunting): picked mon.noname-c con 0x7fc57806a7f0 addr v2:172.21.15.173:3300/0 2024-04-09T12:05:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc57806ba70 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc5780afea0 0x7fc5781458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 10 monclient(hunting): picked mon.noname-a con 0x7fc5780afea0 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57806abd0 con 0x7fc57806ba70 2024-04-09T12:05:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57806fa80 con 0x7fc5780afea0 2024-04-09T12:05:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57806fd60 con 0x7fc57806a7f0 2024-04-09T12:05:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc5805dd640 10 monclient(hunting): authenticate will time out at 1394.884159s 2024-04-09T12:05:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.764+0000 7fc57eb7a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc5780afea0 0x7fc5781458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.765+0000 7fc57eb7a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc5780afea0 0x7fc5781458b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54386/0 (socket says 172.21.15.29:54386) 2024-04-09T12:05:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.765+0000 7fc57eb7a640 1 -- 172.21.15.29:0/343029201 learned_addr learned my addr 172.21.15.29:0/343029201 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.765+0000 7fc57eb7a640 10 monclient(hunting): get_auth_request con 0x7fc5780afea0 auth_method 0 2024-04-09T12:05:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.765+0000 7fc57eb7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.765+0000 7fc57eb7a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.765+0000 7fc57eb7a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.765+0000 7fc57eb7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.765+0000 7fc57eb7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.765+0000 7fc57eb7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.767+0000 7fc57eb7a640 10 monclient(hunting): handle_auth_done global_id 4353 payload 274 2024-04-09T12:05:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.767+0000 7fc57eb7a640 1 -- 172.21.15.29:0/343029201 >> v2:172.21.15.173:3300/0 conn(0x7fc57806a7f0 msgr2=0x7fc5780af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.767+0000 7fc57eb7a640 1 --2- 172.21.15.29:0/343029201 >> v2:172.21.15.173:3300/0 conn(0x7fc57806a7f0 0x7fc5780af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.767+0000 7fc57eb7a640 1 -- 172.21.15.29:0/343029201 >> v1:172.21.15.173:6789/0 conn(0x7fc57806ba70 legacy=0x7fc5781451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.767+0000 7fc57eb7a640 10 monclient: _finish_hunting 0 2024-04-09T12:05:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.767+0000 7fc57eb7a640 1 monclient: found mon.noname-a 2024-04-09T12:05:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.767+0000 7fc57eb7a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.767+0000 7fc57eb7a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.767+0000 7fc57eb7a640 1 -- 172.21.15.29:0/343029201 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57806b620 con 0x7fc5780afea0 2024-04-09T12:05:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.769+0000 7fc57eb7a640 1 --2- 172.21.15.29:0/343029201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5780afea0 0x7fc5781458b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5780b11a0 tx=0x7fc57002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da7e0dc9a998df6 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 1 -- 172.21.15.29:0/343029201 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700317e0 con 0x7fc5780afea0 2024-04-09T12:05:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 10 monclient: dump: 2024-04-09T12:05:28.781 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:28.781 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.781 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.781 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.781 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 10 monclient: _finish_auth 0 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 10 monclient: _check_auth_tickets 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 1 -- 172.21.15.29:0/343029201 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc570031940 con 0x7fc5780afea0 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 5 monclient: authenticate success, global_id 4353 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 1 -- 172.21.15.29:0/343029201 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570031cd0 con 0x7fc5780afea0 2024-04-09T12:05:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 4 set_mon_vals no callback set 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc57d377640 10 monclient: dump: 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:28.783 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 10 monclient: shutdown 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 1 -- 172.21.15.29:0/343029201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5780afea0 msgr2=0x7fc5781458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 1 --2- 172.21.15.29:0/343029201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5780afea0 0x7fc5781458b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5780b11a0 tx=0x7fc57002b880 comp rx=0 tx=0).stop 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 1 -- 172.21.15.29:0/343029201 shutdown_connections 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 1 --2- 172.21.15.29:0/343029201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5780afea0 0x7fc5781458b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 1 --2- 172.21.15.29:0/343029201 >> v2:172.21.15.173:3300/0 conn(0x7fc57806a7f0 0x7fc5780af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 1 -- 172.21.15.29:0/343029201 >> 172.21.15.29:0/343029201 conn(0x7fc5780b4f60 msgr2=0x7fc5780b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 1 -- 172.21.15.29:0/343029201 shutdown_connections 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.773+0000 7fc5805dd640 1 -- 172.21.15.29:0/343029201 wait complete. 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.774+0000 7fc5805dd640 10 monclient: build_initial_monmap 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.774+0000 7fc5805dd640 10 monclient: monmap: 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 librados: starting msgr at 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 librados: starting objecter 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 Processor -- start 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 -- start start 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 librados: setting wanted keys 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 librados: calling monclient init 2024-04-09T12:05:28.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 10 monclient: init 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57806a7f0 0x7fc57813f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 10 monclient(hunting): picked mon.noname-a con 0x7fc57806a7f0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc57806ba70 0x7fc5781d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 10 monclient(hunting): picked mon.noname-b con 0x7fc57806ba70 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc5780afea0 0x7fc578147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 10 monclient(hunting): picked mon.noname-c con 0x7fc5780afea0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5781d65a0 con 0x7fc57806a7f0 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5781d6880 con 0x7fc57806ba70 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5781469d0 con 0x7fc5780afea0 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.775+0000 7fc5805dd640 10 monclient(hunting): authenticate will time out at 1394.895867s 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57e379640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57806a7f0 0x7fc57813f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57eb7a640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc5780afea0 0x7fc578147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57e379640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57806a7f0 0x7fc57813f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54402/0 (socket says 172.21.15.29:54402) 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57e379640 1 -- 172.21.15.29:0/259932766 learned_addr learned my addr 172.21.15.29:0/259932766 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57e379640 10 monclient(hunting): get_auth_request con 0x7fc57806a7f0 auth_method 0 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57e379640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57e379640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57e379640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57eb7a640 10 monclient(hunting): get_auth_request con 0x7fc5780afea0 auth_method 0 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57eb7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57eb7a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.776+0000 7fc57eb7a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.777+0000 7fc57e379640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.777+0000 7fc57e379640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.777+0000 7fc57e379640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.777+0000 7fc57eb7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.777+0000 7fc57eb7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.777+0000 7fc57eb7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:28.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.779+0000 7fc57e379640 10 monclient(hunting): handle_auth_done global_id 4356 payload 824 2024-04-09T12:05:28.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.779+0000 7fc57e379640 1 -- 172.21.15.29:0/259932766 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc5780afea0 msgr2=0x7fc578147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.779+0000 7fc57e379640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc5780afea0 0x7fc578147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.779+0000 7fc57e379640 1 -- 172.21.15.29:0/259932766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc57806ba70 msgr2=0x7fc5781d6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.779+0000 7fc57e379640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc57806ba70 0x7fc5781d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.779+0000 7fc57e379640 10 monclient: _finish_hunting 0 2024-04-09T12:05:28.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.779+0000 7fc57e379640 1 monclient: found mon.noname-a 2024-04-09T12:05:28.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.780+0000 7fc57e379640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:28.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.780+0000 7fc57e379640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.780+0000 7fc57e379640 1 -- 172.21.15.29:0/259932766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700094d0 con 0x7fc57806a7f0 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.782+0000 7fc57e379640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57806a7f0 0x7fc57813f300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc56800ba80 tx=0x7fc56800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.782+0000 7fc576ffd640 10 client.?.objecter ms_handle_connect 0x7fc57806a7f0 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.782+0000 7fc576ffd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 1 -- 172.21.15.29:0/259932766 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56800cc00 con 0x7fc57806a7f0 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 10 monclient: dump: 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 10 monclient: _finish_auth 0 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 1 -- 172.21.15.29:0/259932766 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56800cd80 con 0x7fc57806a7f0 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc5805dd640 5 monclient: authenticate success, global_id 4356 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc5805dd640 10 monclient: _renew_subs 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc5805dd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc5805dd640 1 -- 172.21.15.29:0/259932766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5781d7250 con 0x7fc57806a7f0 2024-04-09T12:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 1 -- 172.21.15.29:0/259932766 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568014680 con 0x7fc57806a7f0 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc576ffd640 10 monclient: dump: 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc57cb76640 4 set_mon_vals no callback set 2024-04-09T12:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc5805dd640 10 client.4356.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc5805dd640 10 monclient: _renew_subs 2024-04-09T12:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc5805dd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc5805dd640 1 -- 172.21.15.29:0/259932766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc578147c90 con 0x7fc57806a7f0 2024-04-09T12:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.786+0000 7fc5805dd640 1 librados: init done 2024-04-09T12:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.787+0000 7fc5805dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.787+0000 7fc5805dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.787+0000 7fc5805dd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.787+0000 7fc5805dd640 1 -- 172.21.15.29:0/259932766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc578146bf0 con 0x7fc57806a7f0 2024-04-09T12:05:28.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.858+0000 7f135ffff640 1 -- 172.21.15.29:0/3629561480 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f1368054f20 con 0x7f13780a8f10 2024-04-09T12:05:28.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.859+0000 7f135ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:28.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.859+0000 7f135ffff640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:28.874 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-09T12:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.974+0000 7fdff64cf640 10 monclient: get_monmap_and_config 2024-04-09T12:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.974+0000 7fdff64cf640 10 monclient: build_initial_monmap 2024-04-09T12:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.974+0000 7fdff64cf640 10 monclient: monmap: 2024-04-09T12:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:28.975783+0000 2024-04-09T12:05:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:28.975783+0000 2024-04-09T12:05:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:28.979 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.974+0000 7fdff64cf640 1 Processor -- start 2024-04-09T12:05:28.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 1 -- start start 2024-04-09T12:05:28.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 10 monclient: init 2024-04-09T12:05:28.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:28.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2024-04-09T12:05:28.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00b7b10 0x7fdff00a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 10 monclient(hunting): picked mon.noname-b con 0x7fdff00b7b10 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:28.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdff00a8f10 0x7fdff013eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 10 monclient(hunting): picked mon.noname-a con 0x7fdff00a8f10 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:28.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdff013efe0 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:28.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff00aa840 con 0x7fdff013efe0 2024-04-09T12:05:28.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff013f470 con 0x7fdff00a8f10 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00b7ef0 con 0x7fdff00b7b10 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.975+0000 7fdff64cf640 10 monclient(hunting): authenticate will time out at 1395.095693s 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.976+0000 7fdfeffff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00b7b10 0x7fdff00a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.976+0000 7fdfeffff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00b7b10 0x7fdff00a89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:56248/0 (socket says 172.21.15.29:56248) 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.976+0000 7fdfeffff640 1 -- 172.21.15.29:0/3845180318 learned_addr learned my addr 172.21.15.29:0/3845180318 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.976+0000 7fdfeffff640 10 monclient(hunting): get_auth_request con 0x7fdff00b7b10 auth_method 0 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.976+0000 7fdfeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.976+0000 7fdfeffff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.976+0000 7fdfeffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.977+0000 7fdfeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.977+0000 7fdfeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.977+0000 7fdfeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.979+0000 7fdfeffff640 10 monclient(hunting): handle_auth_done global_id 4349 payload 274 2024-04-09T12:05:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.979+0000 7fdfeffff640 1 -- 172.21.15.29:0/3845180318 >> v2:172.21.15.29:3300/0 conn(0x7fdff00a8f10 msgr2=0x7fdff013eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.979+0000 7fdfeffff640 1 --2- 172.21.15.29:0/3845180318 >> v2:172.21.15.29:3300/0 conn(0x7fdff00a8f10 0x7fdff013eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.979+0000 7fdfeffff640 1 -- 172.21.15.29:0/3845180318 >> v1:172.21.15.29:6789/0 conn(0x7fdff013efe0 legacy=0x7fdff0144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.979+0000 7fdfeffff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.979+0000 7fdfeffff640 1 monclient: found mon.noname-b 2024-04-09T12:05:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.979+0000 7fdfeffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.979+0000 7fdfeffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.979+0000 7fdfeffff640 1 -- 172.21.15.29:0/3845180318 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00a93c0 con 0x7fdff00b7b10 2024-04-09T12:05:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.981+0000 7fdfeffff640 1 --2- 172.21.15.29:0/3845180318 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00b7b10 0x7fdff00a89d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009870 tx=0x7fdfe002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddcf4d9932a56ee2 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 1 -- 172.21.15.29:0/3845180318 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0031640 con 0x7fdff00b7b10 2024-04-09T12:05:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 10 monclient: dump: 2024-04-09T12:05:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:28.989 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 10 monclient: _finish_auth 0 2024-04-09T12:05:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdff64cf640 5 monclient: authenticate success, global_id 4349 2024-04-09T12:05:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 1 -- 172.21.15.29:0/3845180318 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe00317a0 con 0x7fdff00b7b10 2024-04-09T12:05:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdff64cf640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 1 -- 172.21.15.29:0/3845180318 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0031b30 con 0x7fdff00b7b10 2024-04-09T12:05:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdff64cf640 4 set_mon_vals no callback set 2024-04-09T12:05:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.985+0000 7fdfeeffd640 10 monclient: dump: 2024-04-09T12:05:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:28.991 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:28.991 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.991 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:28.991 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:28.991 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.991 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:28.991 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:28.991 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:28.991 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.986+0000 7fdff64cf640 10 monclient: shutdown 2024-04-09T12:05:28.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.986+0000 7fdff64cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:28.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.986+0000 7fdff64cf640 1 -- 172.21.15.29:0/3845180318 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00b7b10 msgr2=0x7fdff00a89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:28.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.986+0000 7fdff64cf640 1 --2- 172.21.15.29:0/3845180318 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00b7b10 0x7fdff00a89d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009870 tx=0x7fdfe002b8f0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.986+0000 7fdff64cf640 1 -- 172.21.15.29:0/3845180318 shutdown_connections 2024-04-09T12:05:28.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.986+0000 7fdff64cf640 1 --2- 172.21.15.29:0/3845180318 >> v2:172.21.15.29:3300/0 conn(0x7fdff00a8f10 0x7fdff013eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.986+0000 7fdff64cf640 1 --2- 172.21.15.29:0/3845180318 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00b7b10 0x7fdff00a89d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.986+0000 7fdff64cf640 1 -- 172.21.15.29:0/3845180318 >> 172.21.15.29:0/3845180318 conn(0x7fdff0066140 msgr2=0x7fdff00b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.986+0000 7fdff64cf640 1 -- 172.21.15.29:0/3845180318 shutdown_connections 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.986+0000 7fdff64cf640 1 -- 172.21.15.29:0/3845180318 wait complete. 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.987+0000 7fdff64cf640 10 monclient: build_initial_monmap 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.987+0000 7fdff64cf640 10 monclient: monmap: 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:28.995 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.987+0000 7fdff64cf640 1 librados: starting msgr at 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.987+0000 7fdff64cf640 1 librados: starting objecter 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.987+0000 7fdff64cf640 1 Processor -- start 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.987+0000 7fdff64cf640 1 -- start start 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.987+0000 7fdff64cf640 1 librados: setting wanted keys 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.987+0000 7fdff64cf640 1 librados: calling monclient init 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.987+0000 7fdff64cf640 10 monclient: init 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00a8f10 0x7fdff0142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 10 monclient(hunting): picked mon.noname-c con 0x7fdff00a8f10 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:28.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdff00b7b10 0x7fdff01473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 10 monclient(hunting): picked mon.noname-a con 0x7fdff00b7b10 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:28.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff013efe0 0x7fdff01480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:28.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 10 monclient(hunting): picked mon.noname-b con 0x7fdff013efe0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:28.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01478f0 con 0x7fdff00b7b10 2024-04-09T12:05:28.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0143a20 con 0x7fdff013efe0 2024-04-09T12:05:28.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:28.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0143ee0 con 0x7fdff00a8f10 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.988+0000 7fdff64cf640 10 monclient(hunting): authenticate will time out at 1395.108626s 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdfeffff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00a8f10 0x7fdff0142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdff4a6c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff013efe0 0x7fdff01480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdfeffff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00a8f10 0x7fdff0142f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:56264/0 (socket says 172.21.15.29:56264) 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdfeffff640 1 -- 172.21.15.29:0/1650838926 learned_addr learned my addr 172.21.15.29:0/1650838926 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdfeffff640 10 monclient(hunting): get_auth_request con 0x7fdff00a8f10 auth_method 0 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdfeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdfeffff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdfeffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdff4a6c640 10 monclient(hunting): get_auth_request con 0x7fdff013efe0 auth_method 0 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdff4a6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:28.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdff4a6c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:28.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.989+0000 7fdff4a6c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:28.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.990+0000 7fdfeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:28.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.990+0000 7fdfeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:28.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.990+0000 7fdfeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:28.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.990+0000 7fdff4a6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:28.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.990+0000 7fdff4a6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:28.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.990+0000 7fdff4a6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:29.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.992+0000 7fdff4a6c640 10 monclient(hunting): handle_auth_done global_id 4414 payload 824 2024-04-09T12:05:29.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.993+0000 7fdff4a6c640 1 -- 172.21.15.29:0/1650838926 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00a8f10 msgr2=0x7fdff0142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.993+0000 7fdff4a6c640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00a8f10 0x7fdff0142f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.993+0000 7fdff4a6c640 1 -- 172.21.15.29:0/1650838926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdff00b7b10 msgr2=0x7fdff01473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.993+0000 7fdff4a6c640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdff00b7b10 0x7fdff01473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.993+0000 7fdff4a6c640 10 monclient: _finish_hunting 0 2024-04-09T12:05:29.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.993+0000 7fdff4a6c640 1 monclient: found mon.noname-b 2024-04-09T12:05:29.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.993+0000 7fdff4a6c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:29.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.993+0000 7fdff4a6c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:29.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.993+0000 7fdff4a6c640 1 -- 172.21.15.29:0/1650838926 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe00094d0 con 0x7fdff013efe0 2024-04-09T12:05:29.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.995+0000 7fdff4a6c640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff013efe0 0x7fdff01480a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800be20 tx=0x7fdfe800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:29.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.995+0000 7fdfecff9640 10 client.?.objecter ms_handle_connect 0x7fdff013efe0 2024-04-09T12:05:29.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.995+0000 7fdfecff9640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:29.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 1 -- 172.21.15.29:0/1650838926 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800ce70 con 0x7fdff013efe0 2024-04-09T12:05:29.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:29.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:29.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 10 monclient: dump: 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 10 monclient: _finish_auth 0 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 10 monclient: _check_auth_tickets 2024-04-09T12:05:29.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:29.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdff64cf640 5 monclient: authenticate success, global_id 4414 2024-04-09T12:05:29.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 1 -- 172.21.15.29:0/1650838926 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe8014440 con 0x7fdff013efe0 2024-04-09T12:05:29.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:29.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 1 -- 172.21.15.29:0/1650838926 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8014830 con 0x7fdff013efe0 2024-04-09T12:05:29.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdff64cf640 10 monclient: _renew_subs 2024-04-09T12:05:29.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdff64cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:29.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdff64cf640 1 -- 172.21.15.29:0/1650838926 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff01da220 con 0x7fdff013efe0 2024-04-09T12:05:29.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:29.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:29.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfee7fc640 4 set_mon_vals no callback set 2024-04-09T12:05:29.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdfecff9640 10 monclient: dump: 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdff64cf640 10 client.4414.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdff64cf640 10 monclient: _renew_subs 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdff64cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdff64cf640 1 -- 172.21.15.29:0/1650838926 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff01487c0 con 0x7fdff013efe0 2024-04-09T12:05:29.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.998+0000 7fdff64cf640 1 librados: init done 2024-04-09T12:05:29.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.999+0000 7fdff64cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:29.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.999+0000 7fdff64cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:29.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.999+0000 7fdff64cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:29.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:28.999+0000 7fdff64cf640 1 -- 172.21.15.29:0/1650838926 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff004e160 con 0x7fdff013efe0 2024-04-09T12:05:29.006 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-09T12:05:29.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.047+0000 7f137dc05640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-09T12:05:29.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.047+0000 7f137dc05640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-09T12:05:29.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.047+0000 7f137dc05640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:29.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.047+0000 7f137dc05640 1 -- 172.21.15.29:0/3629561480 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f13780b2ec0 con 0x7f13780a8f10 2024-04-09T12:05:29.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.058+0000 7fc576ffd640 1 -- 172.21.15.29:0/259932766 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc56801d3b0 con 0x7fc57806a7f0 2024-04-09T12:05:29.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.058+0000 7fc576ffd640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc56406c610 0x7fc56406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.058+0000 7fc57db78640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc56406c610 0x7fc56406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:29.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.058+0000 7fc57db78640 10 monclient: get_auth_request con 0x7fc56406c610 auth_method 0 2024-04-09T12:05:29.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.059+0000 7fc576ffd640 10 client.4356.objecter ms_handle_connect 0x7fc56406c610 2024-04-09T12:05:29.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.059+0000 7fc57db78640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc56406c610 0x7fc56406ead0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc578146490 tx=0x7fc56c007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:29.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.082+0000 7fc576ffd640 1 -- 172.21.15.29:0/259932766 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc568058470 con 0x7fc57806a7f0 2024-04-09T12:05:29.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.082+0000 7fc576ffd640 10 client.4356.objecter ms_dispatch 0x7fc578000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:29.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.082+0000 7fc576ffd640 3 client.4356.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:29.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.082+0000 7fc576ffd640 3 client.4356.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:29.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.082+0000 7fc576ffd640 20 client.4356.objecter dump_active .. 0 homeless 2024-04-09T12:05:29.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.082+0000 7fc576ffd640 1 -- 172.21.15.29:0/259932766 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fc5680547b0 con 0x7fc57806a7f0 2024-04-09T12:05:29.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.082+0000 7fc576ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:29.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.082+0000 7fc576ffd640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:29.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-09T12:05:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.126+0000 7fe4364d3640 10 monclient: get_monmap_and_config 2024-04-09T12:05:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.126+0000 7fe4364d3640 10 monclient: build_initial_monmap 2024-04-09T12:05:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.126+0000 7fe4364d3640 10 monclient: monmap: 2024-04-09T12:05:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:29.127697+0000 2024-04-09T12:05:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:29.127697+0000 2024-04-09T12:05:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:29.130 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.126+0000 7fe4364d3640 1 Processor -- start 2024-04-09T12:05:29.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 1 -- start start 2024-04-09T12:05:29.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 10 monclient: init 2024-04-09T12:05:29.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:29.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 10 monclient: _add_conns ranks=[0,3,1,2,4] 2024-04-09T12:05:29.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe4300b43d0 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe43013f080 0x7fe4300a8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 10 monclient(hunting): picked mon.noname-a con 0x7fe43013f080 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe430144c50 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4300aa750 con 0x7fe4300b43d0 2024-04-09T12:05:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4300a9060 con 0x7fe430144c50 2024-04-09T12:05:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4300a8e80 con 0x7fe43013f080 2024-04-09T12:05:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.127+0000 7fe4364d3640 10 monclient(hunting): authenticate will time out at 1395.247770s 2024-04-09T12:05:29.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.130+0000 7fe42f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe43013f080 0x7fe4300a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:29.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.130+0000 7fe42ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe4300b43d0 0x7fe43013e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33116/0 (socket says 172.21.15.29:33116) 2024-04-09T12:05:29.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.130+0000 7fe42ffff640 1 -- 172.21.15.29:0/3824373179 learned_addr learned my addr 172.21.15.29:0/3824373179 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:29.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.135+0000 7fe42f7fe640 10 monclient(hunting): get_auth_request con 0x7fe43013f080 auth_method 0 2024-04-09T12:05:29.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.135+0000 7fe42f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:29.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.135+0000 7fe42f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:29.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.135+0000 7fe42f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:29.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.165+0000 7fe42f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:29.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.165+0000 7fe42f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:29.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.165+0000 7fe42f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:29.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.173+0000 7fe42f7fe640 10 monclient(hunting): handle_auth_done global_id 4359 payload 274 2024-04-09T12:05:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.173+0000 7fe42f7fe640 1 -- 172.21.15.29:0/3824373179 >> v1:172.21.15.173:6789/0 conn(0x7fe430144c50 legacy=0x7fe4301450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.173+0000 7fe42f7fe640 1 -- 172.21.15.29:0/3824373179 >> v1:172.21.15.29:6789/0 conn(0x7fe4300b43d0 legacy=0x7fe43013e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.173+0000 7fe42f7fe640 10 monclient: _finish_hunting 0 2024-04-09T12:05:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.173+0000 7fe42f7fe640 1 monclient: found mon.noname-a 2024-04-09T12:05:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.173+0000 7fe42f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.173+0000 7fe42f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.173+0000 7fe42f7fe640 1 -- 172.21.15.29:0/3824373179 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4300a9580 con 0x7fe43013f080 2024-04-09T12:05:29.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.184+0000 7fe42f7fe640 1 --2- 172.21.15.29:0/3824373179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43013f080 0x7fe4300a8940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe4240097a0 tx=0x7fe42402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c5953ce47e14f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 1 -- 172.21.15.29:0/3824373179 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424031830 con 0x7fe43013f080 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 10 monclient: dump: 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:29.193 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 10 monclient: _finish_auth 0 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 1 -- 172.21.15.29:0/3824373179 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424031990 con 0x7fe43013f080 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 1 -- 172.21.15.29:0/3824373179 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424031d20 con 0x7fe43013f080 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe42effd640 10 monclient: dump: 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.194 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.195 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.195 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:29.195 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.195 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:29.195 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:29.195 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:29.195 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe4364d3640 5 monclient: authenticate success, global_id 4359 2024-04-09T12:05:29.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe4364d3640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:29.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.190+0000 7fe4364d3640 4 set_mon_vals no callback set 2024-04-09T12:05:29.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.191+0000 7fe4364d3640 10 monclient: shutdown 2024-04-09T12:05:29.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.191+0000 7fe4364d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:29.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.191+0000 7fe4364d3640 1 -- 172.21.15.29:0/3824373179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43013f080 msgr2=0x7fe4300a8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.191+0000 7fe4364d3640 1 --2- 172.21.15.29:0/3824373179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43013f080 0x7fe4300a8940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe4240097a0 tx=0x7fe42402b8d0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.191+0000 7fe4364d3640 1 -- 172.21.15.29:0/3824373179 shutdown_connections 2024-04-09T12:05:29.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.191+0000 7fe4364d3640 1 --2- 172.21.15.29:0/3824373179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43013f080 0x7fe4300a8940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.191+0000 7fe4364d3640 1 -- 172.21.15.29:0/3824373179 >> 172.21.15.29:0/3824373179 conn(0x7fe430065f30 msgr2=0x7fe430066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:29.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.191+0000 7fe4364d3640 1 -- 172.21.15.29:0/3824373179 shutdown_connections 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.191+0000 7fe4364d3640 1 -- 172.21.15.29:0/3824373179 wait complete. 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.192+0000 7fe4364d3640 10 monclient: build_initial_monmap 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.192+0000 7fe4364d3640 10 monclient: monmap: 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.192+0000 7fe4364d3640 1 librados: starting msgr at 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.192+0000 7fe4364d3640 1 librados: starting objecter 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.192+0000 7fe4364d3640 1 Processor -- start 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.192+0000 7fe4364d3640 1 -- start start 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.192+0000 7fe4364d3640 1 librados: setting wanted keys 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.192+0000 7fe4364d3640 1 librados: calling monclient init 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.192+0000 7fe4364d3640 10 monclient: init 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4300b43d0 0x7fe430131e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 10 monclient(hunting): picked mon.noname-c con 0x7fe4300b43d0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43013f080 0x7fe43012f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 10 monclient(hunting): picked mon.noname-a con 0x7fe43013f080 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe430144c50 0x7fe43012f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 10 monclient(hunting): picked mon.noname-b con 0x7fe430144c50 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:29.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:29.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4301344b0 con 0x7fe43013f080 2024-04-09T12:05:29.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:29.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe430131410 con 0x7fe430144c50 2024-04-09T12:05:29.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:29.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4301310e0 con 0x7fe4300b43d0 2024-04-09T12:05:29.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:29.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.193+0000 7fe4364d3640 10 monclient(hunting): authenticate will time out at 1395.313666s 2024-04-09T12:05:29.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.195+0000 7fe42f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43013f080 0x7fe43012f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:29.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.195+0000 7fe42f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43013f080 0x7fe43012f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54444/0 (socket says 172.21.15.29:54444) 2024-04-09T12:05:29.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.195+0000 7fe42f7fe640 1 -- 172.21.15.29:0/3866930730 learned_addr learned my addr 172.21.15.29:0/3866930730 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:29.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.195+0000 7fe42f7fe640 10 monclient(hunting): get_auth_request con 0x7fe43013f080 auth_method 0 2024-04-09T12:05:29.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.195+0000 7fe42f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:29.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.195+0000 7fe42f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:29.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.195+0000 7fe42f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:29.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.196+0000 7fe42f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:29.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.196+0000 7fe42f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:29.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.196+0000 7fe42f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:29.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.199+0000 7fe42f7fe640 10 monclient(hunting): handle_auth_done global_id 4362 payload 824 2024-04-09T12:05:29.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.199+0000 7fe42f7fe640 1 -- 172.21.15.29:0/3866930730 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4300b43d0 msgr2=0x7fe430131e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.199+0000 7fe42f7fe640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4300b43d0 0x7fe430131e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.199+0000 7fe42f7fe640 1 -- 172.21.15.29:0/3866930730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe430144c50 msgr2=0x7fe43012f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.199+0000 7fe42f7fe640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe430144c50 0x7fe43012f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.199+0000 7fe42f7fe640 10 monclient: _finish_hunting 0 2024-04-09T12:05:29.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.199+0000 7fe42f7fe640 1 monclient: found mon.noname-a 2024-04-09T12:05:29.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.199+0000 7fe42f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:29.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.199+0000 7fe42f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.199+0000 7fe42f7fe640 1 -- 172.21.15.29:0/3866930730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe424009400 con 0x7fe43013f080 2024-04-09T12:05:29.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.202+0000 7fe42f7fe640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43013f080 0x7fe43012f000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe42402bee0 tx=0x7fe4240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:29.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.202+0000 7fe42cff9640 10 client.?.objecter ms_handle_connect 0x7fe43013f080 2024-04-09T12:05:29.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.202+0000 7fe42cff9640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:29.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 1 -- 172.21.15.29:0/3866930730 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42403ba30 con 0x7fe43013f080 2024-04-09T12:05:29.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:29.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:29.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 10 monclient: dump: 2024-04-09T12:05:29.209 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:29.209 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 10 monclient: _finish_auth 0 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 10 monclient: _check_auth_tickets 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 1 -- 172.21.15.29:0/3866930730 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42403bbb0 con 0x7fe43013f080 2024-04-09T12:05:29.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 1 -- 172.21.15.29:0/3866930730 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4240433f0 con 0x7fe43013f080 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42cff9640 10 monclient: dump: 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:29.211 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe4364d3640 5 monclient: authenticate success, global_id 4362 2024-04-09T12:05:29.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe4364d3640 10 monclient: _renew_subs 2024-04-09T12:05:29.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe4364d3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe4364d3640 1 -- 172.21.15.29:0/3866930730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4301334a0 con 0x7fe43013f080 2024-04-09T12:05:29.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe42e7fc640 4 set_mon_vals no callback set 2024-04-09T12:05:29.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe4364d3640 10 client.4362.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:29.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe4364d3640 10 monclient: _renew_subs 2024-04-09T12:05:29.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe4364d3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe4364d3640 1 -- 172.21.15.29:0/3866930730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe430133f20 con 0x7fe43013f080 2024-04-09T12:05:29.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.206+0000 7fe4364d3640 1 librados: init done 2024-04-09T12:05:29.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.207+0000 7fe4364d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:29.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.207+0000 7fe4364d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:29.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.207+0000 7fe4364d3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.207+0000 7fe4364d3640 1 -- 172.21.15.29:0/3866930730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43004e160 con 0x7fe43013f080 2024-04-09T12:05:29.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.210+0000 7fd4a8fd5640 10 monclient: get_monmap_and_config 2024-04-09T12:05:29.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.210+0000 7fd4a8fd5640 10 monclient: build_initial_monmap 2024-04-09T12:05:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.210+0000 7fd4a8fd5640 10 monclient: monmap: 2024-04-09T12:05:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:29.212207+0000 2024-04-09T12:05:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:29.212207+0000 2024-04-09T12:05:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:29.215 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:29.215 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.211+0000 7fd4a8fd5640 1 Processor -- start 2024-04-09T12:05:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.211+0000 7fd4a8fd5640 1 -- start start 2024-04-09T12:05:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.211+0000 7fd4a8fd5640 10 monclient: init 2024-04-09T12:05:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 10 monclient: _add_conns ranks=[0,3,1,2,4] 2024-04-09T12:05:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd4a40b43d0 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd4a413f080 0x7fd4a40a8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 10 monclient(hunting): picked mon.noname-a con 0x7fd4a413f080 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd4a4144c50 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a40aa750 con 0x7fd4a40b43d0 2024-04-09T12:05:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a40a9060 con 0x7fd4a4144c50 2024-04-09T12:05:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a40a8e80 con 0x7fd4a413f080 2024-04-09T12:05:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.212+0000 7fd4a8fd5640 10 monclient(hunting): authenticate will time out at 1395.332604s 2024-04-09T12:05:29.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.249+0000 7fdfecff9640 1 -- 172.21.15.29:0/1650838926 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdfe801d3b0 con 0x7fdff013efe0 2024-04-09T12:05:29.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.249+0000 7fdfecff9640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fdfdc06c5e0 0x7fdfdc06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.249+0000 7fdfeffff640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fdfdc06c5e0 0x7fdfdc06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:29.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.249+0000 7fdfeffff640 10 monclient: get_auth_request con 0x7fdfdc06c5e0 auth_method 0 2024-04-09T12:05:29.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.250+0000 7fdfeffff640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fdfdc06c5e0 0x7fdfdc06eaa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdfe002b930 tx=0x7fdfe003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:29.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.250+0000 7fdfecff9640 10 client.4414.objecter ms_handle_connect 0x7fdfdc06c5e0 2024-04-09T12:05:29.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.251+0000 7fdfecff9640 1 -- 172.21.15.29:0/1650838926 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdfe8058880 con 0x7fdff013efe0 2024-04-09T12:05:29.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.251+0000 7fdfecff9640 10 client.4414.objecter ms_dispatch 0x7fdff0000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:29.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.251+0000 7fdfecff9640 3 client.4414.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:29.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.251+0000 7fdfecff9640 3 client.4414.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:29.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.251+0000 7fdfecff9640 20 client.4414.objecter dump_active .. 0 homeless 2024-04-09T12:05:29.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.261+0000 7fdfecff9640 1 -- 172.21.15.29:0/1650838926 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fdfe8054bc0 con 0x7fdff013efe0 2024-04-09T12:05:29.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.261+0000 7fdfecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:29.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.261+0000 7fdfecff9640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:29.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.269+0000 7f135ffff640 1 -- 172.21.15.29:0/3629561480 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1368017090 con 0x7f13780a8f10 2024-04-09T12:05:29.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.269+0000 7f135ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-09T12:05:29.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.269+0000 7f135ffff640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:29.272 INFO:teuthology.orchestra.run.smithi029.stdout:64424509446 2024-04-09T12:05:29.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 10 librados: watch_flush enter 2024-04-09T12:05:29.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 10 librados: watch_flush exit 2024-04-09T12:05:29.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 20 client.4411.objecter shutdown clearing up homeless session... 2024-04-09T12:05:29.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 10 client.4411.objecter successfully canceled tick 2024-04-09T12:05:29.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7fd4a2d9d640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd4a4144c50 0x7fd4a41450e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:37932/0 (socket says 172.21.15.29:37932) 2024-04-09T12:05:29.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7fd4a2d9d640 1 -- 172.21.15.29:0/3591940616 learned_addr learned my addr 172.21.15.29:0/3591940616 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:29.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 -- 172.21.15.29:0/3629561480 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f136406c5e0 msgr2=0x7f136406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f136406c5e0 0x7f136406eaa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f136c036000 tx=0x7f136c03c040 comp rx=0 tx=0).stop 2024-04-09T12:05:29.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 10 monclient: shutdown 2024-04-09T12:05:29.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:29.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 -- 172.21.15.29:0/3629561480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13780a8f10 msgr2=0x7f13780b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13780a8f10 0x7f13780b4d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f136800e900 tx=0x7f136800edc0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 -- 172.21.15.29:0/3629561480 shutdown_connections 2024-04-09T12:05:29.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f136406c5e0 0x7f136406eaa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f137813efe0 0x7f137813a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13780b7b10 0x7f13781da080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 --2- 172.21.15.29:0/3629561480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13780a8f10 0x7f13780b4d80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 -- 172.21.15.29:0/3629561480 >> 172.21.15.29:0/3629561480 conn(0x7f1378066140 msgr2=0x7f1378144ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:29.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 -- 172.21.15.29:0/3629561480 shutdown_connections 2024-04-09T12:05:29.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.272+0000 7f137dc05640 1 -- 172.21.15.29:0/3629561480 wait complete. 2024-04-09T12:05:29.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.273+0000 7f137dc05640 1 librados: shutdown 2024-04-09T12:05:29.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-04-09T12:05:29.291 DEBUG:teuthology.parallel:result is None 2024-04-09T12:05:29.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.329+0000 7fc5805dd640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-09T12:05:29.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.329+0000 7fc5805dd640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-09T12:05:29.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.329+0000 7fc5805dd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.329+0000 7fc5805dd640 1 -- 172.21.15.29:0/259932766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc5780aee90 con 0x7fc57806a7f0 2024-04-09T12:05:29.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.446+0000 7fdff64cf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-09T12:05:29.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.446+0000 7fdff64cf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-09T12:05:29.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.446+0000 7fdff64cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:29.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.446+0000 7fdff64cf640 1 -- 172.21.15.29:0/1650838926 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdff00b2ec0 con 0x7fdff013efe0 2024-04-09T12:05:29.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.452+0000 7fdfecff9640 1 -- 172.21.15.29:0/1650838926 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfe8019090 con 0x7fdff013efe0 2024-04-09T12:05:29.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.452+0000 7fdfecff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-09T12:05:29.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.452+0000 7fdfecff9640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:29.455 INFO:teuthology.orchestra.run.smithi029.stdout:90194313224 2024-04-09T12:05:29.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 10 librados: watch_flush enter 2024-04-09T12:05:29.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 10 librados: watch_flush exit 2024-04-09T12:05:29.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 20 client.4414.objecter shutdown clearing up homeless session... 2024-04-09T12:05:29.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 10 client.4414.objecter successfully canceled tick 2024-04-09T12:05:29.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 -- 172.21.15.29:0/1650838926 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fdfdc06c5e0 msgr2=0x7fdfdc06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fdfdc06c5e0 0x7fdfdc06eaa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdfe002b930 tx=0x7fdfe003c040 comp rx=0 tx=0).stop 2024-04-09T12:05:29.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 10 monclient: shutdown 2024-04-09T12:05:29.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:29.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 -- 172.21.15.29:0/1650838926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff013efe0 msgr2=0x7fdff01480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff013efe0 0x7fdff01480a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800be20 tx=0x7fdfe800bf10 comp rx=0 tx=0).stop 2024-04-09T12:05:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 -- 172.21.15.29:0/1650838926 shutdown_connections 2024-04-09T12:05:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fdfdc06c5e0 0x7fdfdc06eaa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff013efe0 0x7fdff01480a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdff00b7b10 0x7fdff01473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 --2- 172.21.15.29:0/1650838926 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdff00a8f10 0x7fdff0142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 -- 172.21.15.29:0/1650838926 >> 172.21.15.29:0/1650838926 conn(0x7fdff0066140 msgr2=0x7fdff01446b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 -- 172.21.15.29:0/1650838926 shutdown_connections 2024-04-09T12:05:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 -- 172.21.15.29:0/1650838926 wait complete. 2024-04-09T12:05:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.454+0000 7fdff64cf640 1 librados: shutdown 2024-04-09T12:05:29.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313224 got 90194313224 for osd.1 2024-04-09T12:05:29.468 DEBUG:teuthology.parallel:result is None 2024-04-09T12:05:29.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.486+0000 7fe42cff9640 1 -- 172.21.15.29:0/3866930730 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe42404c3b0 con 0x7fe43013f080 2024-04-09T12:05:29.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.487+0000 7fe42cff9640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe41c06c5e0 0x7fe41c06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.487+0000 7fe42ffff640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe41c06c5e0 0x7fe41c06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:29.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.487+0000 7fe42ffff640 10 monclient: get_auth_request con 0x7fe41c06c5e0 auth_method 0 2024-04-09T12:05:29.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.488+0000 7fe42cff9640 10 client.4362.objecter ms_handle_connect 0x7fe41c06c5e0 2024-04-09T12:05:29.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.488+0000 7fe42ffff640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe41c06c5e0 0x7fe41c06eaa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe420000f60 tx=0x7fe420007a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:29.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.492+0000 7fd49bfff640 1 --2- 172.21.15.29:0/3591940616 >> v2:172.21.15.29:3300/0 conn(0x7fd4a413f080 0x7fd4a40a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:29.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.503+0000 7fe42cff9640 1 -- 172.21.15.29:0/3866930730 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe42407ae00 con 0x7fe43013f080 2024-04-09T12:05:29.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.503+0000 7fe42cff9640 10 client.4362.objecter ms_dispatch 0x7fe430000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:29.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.503+0000 7fe42cff9640 3 client.4362.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:29.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.503+0000 7fe42cff9640 3 client.4362.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:29.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.503+0000 7fe42cff9640 20 client.4362.objecter dump_active .. 0 homeless 2024-04-09T12:05:29.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.503+0000 7fe42cff9640 1 -- 172.21.15.29:0/3866930730 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fe424076a40 con 0x7fe43013f080 2024-04-09T12:05:29.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.503+0000 7fe42cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:29.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.503+0000 7fe42cff9640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:29.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.505+0000 7fd49bfff640 10 monclient(hunting): get_auth_request con 0x7fd4a413f080 auth_method 0 2024-04-09T12:05:29.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.505+0000 7fd49bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:29.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.505+0000 7fd49bfff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:29.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.505+0000 7fd49bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:29.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.508+0000 7fd49bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:29.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.508+0000 7fd49bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:29.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.508+0000 7fd49bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.523+0000 7fd49bfff640 10 monclient(hunting): handle_auth_done global_id 4365 payload 274 2024-04-09T12:05:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.523+0000 7fd49bfff640 1 -- 172.21.15.29:0/3591940616 >> v1:172.21.15.173:6789/0 conn(0x7fd4a4144c50 legacy=0x7fd4a41450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.523+0000 7fd49bfff640 1 -- 172.21.15.29:0/3591940616 >> v1:172.21.15.29:6789/0 conn(0x7fd4a40b43d0 legacy=0x7fd4a413e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.523+0000 7fd49bfff640 10 monclient: _finish_hunting 0 2024-04-09T12:05:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.523+0000 7fd49bfff640 1 monclient: found mon.noname-a 2024-04-09T12:05:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.523+0000 7fd49bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.523+0000 7fd49bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.523+0000 7fd49bfff640 1 -- 172.21.15.29:0/3591940616 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40a9580 con 0x7fd4a413f080 2024-04-09T12:05:29.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.579+0000 7fc576ffd640 1 -- 172.21.15.29:0/259932766 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc568019020 con 0x7fc57806a7f0 2024-04-09T12:05:29.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.579+0000 7fc576ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-09T12:05:29.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.579+0000 7fc576ffd640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:29.583 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-04-09T12:05:29.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 10 librados: watch_flush enter 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 10 librados: watch_flush exit 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 20 client.4356.objecter shutdown clearing up homeless session... 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 10 client.4356.objecter successfully canceled tick 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 -- 172.21.15.29:0/259932766 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc56406c610 msgr2=0x7fc56406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc56406c610 0x7fc56406ead0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc578146490 tx=0x7fc56c007990 comp rx=0 tx=0).stop 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 10 monclient: shutdown 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 -- 172.21.15.29:0/259932766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57806a7f0 msgr2=0x7fc57813f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57806a7f0 0x7fc57813f300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc56800ba80 tx=0x7fc56800bf40 comp rx=0 tx=0).stop 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 -- 172.21.15.29:0/259932766 shutdown_connections 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fc56406c610 0x7fc56406ead0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc5780afea0 0x7fc578147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc57806ba70 0x7fc5781d6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 --2- 172.21.15.29:0/259932766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57806a7f0 0x7fc57813f300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 -- 172.21.15.29:0/259932766 >> 172.21.15.29:0/259932766 conn(0x7fc5780b4f60 msgr2=0x7fc578144630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:29.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 -- 172.21.15.29:0/259932766 shutdown_connections 2024-04-09T12:05:29.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 -- 172.21.15.29:0/259932766 wait complete. 2024-04-09T12:05:29.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.581+0000 7fc5805dd640 1 librados: shutdown 2024-04-09T12:05:29.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.582+0000 7fd49bfff640 1 --2- 172.21.15.29:0/3591940616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a413f080 0x7fd4a40a8940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0097a0 tx=0x7fd48c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f68e5f4e2165e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:29.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 1 -- 172.21.15.29:0/3591940616 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c030610 con 0x7fd4a413f080 2024-04-09T12:05:29.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:29.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:29.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 10 monclient: dump: 2024-04-09T12:05:29.596 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:29.596 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.596 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.596 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 10 monclient: _finish_auth 0 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 10 monclient: _check_auth_tickets 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 1 -- 172.21.15.29:0/3591940616 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c030770 con 0x7fd4a413f080 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a8fd5640 5 monclient: authenticate success, global_id 4365 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a8fd5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a8fd5640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:29.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a8fd5640 4 set_mon_vals no callback set 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 1 -- 172.21.15.29:0/3591940616 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c030b00 con 0x7fd4a413f080 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.593+0000 7fd4a1d9b640 10 monclient: dump: 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:29.598 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:29.599 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:29.599 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-09T12:05:29.600 DEBUG:teuthology.parallel:result is None 2024-04-09T12:05:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.594+0000 7fd4a8fd5640 10 monclient: shutdown 2024-04-09T12:05:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.594+0000 7fd4a8fd5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.594+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/3591940616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a413f080 msgr2=0x7fd4a40a8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.594+0000 7fd4a8fd5640 1 --2- 172.21.15.29:0/3591940616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a413f080 0x7fd4a40a8940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0097a0 tx=0x7fd48c02b960 comp rx=0 tx=0).stop 2024-04-09T12:05:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.594+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/3591940616 shutdown_connections 2024-04-09T12:05:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.594+0000 7fd4a8fd5640 1 --2- 172.21.15.29:0/3591940616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a413f080 0x7fd4a40a8940 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.594+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/3591940616 >> 172.21.15.29:0/3591940616 conn(0x7fd4a4065f30 msgr2=0x7fd4a4066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.594+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/3591940616 shutdown_connections 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.594+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/3591940616 wait complete. 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.595+0000 7fd4a8fd5640 10 monclient: build_initial_monmap 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.595+0000 7fd4a8fd5640 10 monclient: monmap: 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.595+0000 7fd4a8fd5640 1 librados: starting msgr at 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.595+0000 7fd4a8fd5640 1 librados: starting objecter 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.595+0000 7fd4a8fd5640 1 Processor -- start 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.595+0000 7fd4a8fd5640 1 -- start start 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.595+0000 7fd4a8fd5640 1 librados: setting wanted keys 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.595+0000 7fd4a8fd5640 1 librados: calling monclient init 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.595+0000 7fd4a8fd5640 10 monclient: init 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a40b43d0 0x7fd4a413dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 10 monclient(hunting): picked mon.noname-b con 0x7fd4a40b43d0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4a413f080 0x7fd4a4137be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 10 monclient(hunting): picked mon.noname-c con 0x7fd4a413f080 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a4144c50 0x7fd4a4131270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 10 monclient(hunting): picked mon.noname-a con 0x7fd4a4144c50 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4138290 con 0x7fd4a4144c50 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4138bd0 con 0x7fd4a40b43d0 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4138840 con 0x7fd4a413f080 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a8fd5640 10 monclient(hunting): authenticate will time out at 1395.716281s 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.596+0000 7fd4a2d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a4144c50 0x7fd4a4131270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.597+0000 7fd4a2d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a4144c50 0x7fd4a4131270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54460/0 (socket says 172.21.15.29:54460) 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.597+0000 7fd4a2d9d640 1 -- 172.21.15.29:0/2510126783 learned_addr learned my addr 172.21.15.29:0/2510126783 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.597+0000 7fd4a2d9d640 10 monclient(hunting): get_auth_request con 0x7fd4a4144c50 auth_method 0 2024-04-09T12:05:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.597+0000 7fd4a2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.597+0000 7fd4a2d9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.597+0000 7fd4a2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.597+0000 7fd4a2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.597+0000 7fd4a2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.597+0000 7fd4a2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:29.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.601+0000 7fd4a2d9d640 10 monclient(hunting): handle_auth_done global_id 4371 payload 824 2024-04-09T12:05:29.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.601+0000 7fd4a2d9d640 1 -- 172.21.15.29:0/2510126783 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4a413f080 msgr2=0x7fd4a4137be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.601+0000 7fd4a2d9d640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4a413f080 0x7fd4a4137be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.601+0000 7fd4a2d9d640 1 -- 172.21.15.29:0/2510126783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a40b43d0 msgr2=0x7fd4a413dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.601+0000 7fd4a2d9d640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a40b43d0 0x7fd4a413dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.601+0000 7fd4a2d9d640 10 monclient: _finish_hunting 0 2024-04-09T12:05:29.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.601+0000 7fd4a2d9d640 1 monclient: found mon.noname-a 2024-04-09T12:05:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.601+0000 7fd4a2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.601+0000 7fd4a2d9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.601+0000 7fd4a2d9d640 1 -- 172.21.15.29:0/2510126783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c009400 con 0x7fd4a4144c50 2024-04-09T12:05:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.603+0000 7fd4a2d9d640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a4144c50 0x7fd4a4131270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00cbc0 tx=0x7fd49c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.603+0000 7fd49affd640 10 client.?.objecter ms_handle_connect 0x7fd4a4144c50 2024-04-09T12:05:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.603+0000 7fd49affd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:29.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 1 -- 172.21.15.29:0/2510126783 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00ad40 con 0x7fd4a4144c50 2024-04-09T12:05:29.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:29.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:29.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 10 monclient: dump: 2024-04-09T12:05:29.611 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 10 monclient: _finish_auth 0 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 1 -- 172.21.15.29:0/2510126783 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c012400 con 0x7fd4a4144c50 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 1 -- 172.21.15.29:0/2510126783 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00aea0 con 0x7fd4a4144c50 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd4a8fd5640 5 monclient: authenticate success, global_id 4371 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd4a8fd5640 10 monclient: _renew_subs 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd4a8fd5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/2510126783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a41317b0 con 0x7fd4a4144c50 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd4a159a640 4 set_mon_vals no callback set 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd49affd640 10 monclient: dump: 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd4a8fd5640 10 client.4371.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd4a8fd5640 10 monclient: _renew_subs 2024-04-09T12:05:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd4a8fd5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/2510126783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a4131be0 con 0x7fd4a4144c50 2024-04-09T12:05:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.608+0000 7fd4a8fd5640 1 librados: init done 2024-04-09T12:05:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.609+0000 7fd4a8fd5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.609+0000 7fd4a8fd5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:29.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.609+0000 7fd4a8fd5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.609+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/2510126783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a404e160 con 0x7fd4a4144c50 2024-04-09T12:05:29.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.696+0000 7fe4364d3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-09T12:05:29.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.696+0000 7fe4364d3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-09T12:05:29.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.696+0000 7fe4364d3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:29.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.696+0000 7fe4364d3640 1 -- 172.21.15.29:0/3866930730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe430133c40 con 0x7fe43013f080 2024-04-09T12:05:29.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.879+0000 7fd49affd640 1 -- 172.21.15.29:0/2510126783 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd49c007070 con 0x7fd4a4144c50 2024-04-09T12:05:29.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.879+0000 7fd49affd640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd48406c5e0 0x7fd48406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:29.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.879+0000 7fd4a259c640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd48406c5e0 0x7fd48406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:29.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.879+0000 7fd4a259c640 10 monclient: get_auth_request con 0x7fd48406c5e0 auth_method 0 2024-04-09T12:05:29.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.880+0000 7fd4a259c640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd48406c5e0 0x7fd48406eaa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd494000f60 tx=0x7fd4940079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:29.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.880+0000 7fd49affd640 10 client.4371.objecter ms_handle_connect 0x7fd48406c5e0 2024-04-09T12:05:29.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.912+0000 7fd49affd640 1 -- 172.21.15.29:0/2510126783 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd49c058670 con 0x7fd4a4144c50 2024-04-09T12:05:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.912+0000 7fd49affd640 10 client.4371.objecter ms_dispatch 0x7fd4a4000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.912+0000 7fd49affd640 3 client.4371.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.912+0000 7fd49affd640 3 client.4371.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.912+0000 7fd49affd640 20 client.4371.objecter dump_active .. 0 homeless 2024-04-09T12:05:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.912+0000 7fd49affd640 1 -- 172.21.15.29:0/2510126783 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fd49c0549b0 con 0x7fd4a4144c50 2024-04-09T12:05:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.912+0000 7fd49affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.912+0000 7fd49affd640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:29.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.925+0000 7fe42cff9640 1 -- 172.21.15.29:0/3866930730 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe430133c40 con 0x7fe43013f080 2024-04-09T12:05:29.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.925+0000 7fe42cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-09T12:05:29.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.925+0000 7fe42cff9640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:29.929 INFO:teuthology.orchestra.run.smithi029.stdout:60129542150 2024-04-09T12:05:29.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 10 librados: watch_flush enter 2024-04-09T12:05:29.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 10 librados: watch_flush exit 2024-04-09T12:05:29.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 20 client.4362.objecter shutdown clearing up homeless session... 2024-04-09T12:05:29.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 10 client.4362.objecter successfully canceled tick 2024-04-09T12:05:29.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 1 -- 172.21.15.29:0/3866930730 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe41c06c5e0 msgr2=0x7fe41c06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe41c06c5e0 0x7fe41c06eaa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe420000f60 tx=0x7fe420007a80 comp rx=0 tx=0).stop 2024-04-09T12:05:29.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 10 monclient: shutdown 2024-04-09T12:05:29.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:29.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 1 -- 172.21.15.29:0/3866930730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43013f080 msgr2=0x7fe43012f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:29.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43013f080 0x7fe43012f000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe42402bee0 tx=0x7fe4240046c0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 1 -- 172.21.15.29:0/3866930730 shutdown_connections 2024-04-09T12:05:29.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe41c06c5e0 0x7fe41c06eaa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe430144c50 0x7fe43012f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43013f080 0x7fe43012f000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 1 --2- 172.21.15.29:0/3866930730 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4300b43d0 0x7fe430131e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:29.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.927+0000 7fe4364d3640 1 -- 172.21.15.29:0/3866930730 >> 172.21.15.29:0/3866930730 conn(0x7fe430065f30 msgr2=0x7fe430066310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:29.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.928+0000 7fe4364d3640 1 -- 172.21.15.29:0/3866930730 shutdown_connections 2024-04-09T12:05:29.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.928+0000 7fe4364d3640 1 -- 172.21.15.29:0/3866930730 wait complete. 2024-04-09T12:05:29.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:29.928+0000 7fe4364d3640 1 librados: shutdown 2024-04-09T12:05:29.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-04-09T12:05:29.943 DEBUG:teuthology.parallel:result is None 2024-04-09T12:05:30.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.111+0000 7fd4a8fd5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-09T12:05:30.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.111+0000 7fd4a8fd5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-09T12:05:30.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.111+0000 7fd4a8fd5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:30.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.111+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/2510126783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd4a4139d40 con 0x7fd4a4144c50 2024-04-09T12:05:30.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.166+0000 7fd49affd640 1 -- 172.21.15.29:0/2510126783 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd49c021020 con 0x7fd4a4144c50 2024-04-09T12:05:30.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.166+0000 7fd49affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-09T12:05:30.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.166+0000 7fd49affd640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:30.170 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-04-09T12:05:30.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 10 librados: watch_flush enter 2024-04-09T12:05:30.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 10 librados: watch_flush exit 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 20 client.4371.objecter shutdown clearing up homeless session... 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 10 client.4371.objecter successfully canceled tick 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/2510126783 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd48406c5e0 msgr2=0x7fd48406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd48406c5e0 0x7fd48406eaa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd494000f60 tx=0x7fd4940079b0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 10 monclient: shutdown 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/2510126783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a4144c50 msgr2=0x7fd4a4131270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a4144c50 0x7fd4a4131270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00cbc0 tx=0x7fd49c00a430 comp rx=0 tx=0).stop 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/2510126783 shutdown_connections 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fd48406c5e0 0x7fd48406eaa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a4144c50 0x7fd4a4131270 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4a413f080 0x7fd4a4137be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 --2- 172.21.15.29:0/2510126783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a40b43d0 0x7fd4a413dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/2510126783 >> 172.21.15.29:0/2510126783 conn(0x7fd4a4065f30 msgr2=0x7fd4a41394f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:30.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/2510126783 shutdown_connections 2024-04-09T12:05:30.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 -- 172.21.15.29:0/2510126783 wait complete. 2024-04-09T12:05:30.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.169+0000 7fd4a8fd5640 1 librados: shutdown 2024-04-09T12:05:30.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-04-09T12:05:30.185 DEBUG:teuthology.parallel:result is None 2024-04-09T12:05:30.185 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-09T12:05:30.185 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-09T12:05:30.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.284+0000 7f163ce19640 10 monclient: get_monmap_and_config 2024-04-09T12:05:30.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.284+0000 7f163ce19640 10 monclient: build_initial_monmap 2024-04-09T12:05:30.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.284+0000 7f163ce19640 10 monclient: monmap: 2024-04-09T12:05:30.287 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:30.287 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:30.288 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:30.286067+0000 2024-04-09T12:05:30.288 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:30.286067+0000 2024-04-09T12:05:30.288 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:30.288 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.288 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:30.288 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:30.288 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:30.288 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:30.288 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:30.288 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.285+0000 7f163ce19640 1 Processor -- start 2024-04-09T12:05:30.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.285+0000 7f163ce19640 1 -- start start 2024-04-09T12:05:30.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.285+0000 7f163ce19640 10 monclient: init 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16380b4380 0x7f16380a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 10 monclient(hunting): picked mon.noname-a con 0x7f16380b4380 addr v2:172.21.15.29:3300/0 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f163813e890 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1638141770 0x7f1638141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 10 monclient(hunting): picked mon.noname-b con 0x7f1638141770 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16380a9400 con 0x7f163813e890 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163813f400 con 0x7f16380b4380 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16380b4760 con 0x7f1638141770 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:30.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f163ce19640 10 monclient(hunting): authenticate will time out at 1396.406197s 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f1636d9d640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1638141770 0x7f1638141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f1635d9b640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f163813e890 0x7f163813ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:37942/0 (socket says 172.21.15.29:37942) 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.286+0000 7f1635d9b640 1 -- 172.21.15.29:0/1695835655 learned_addr learned my addr 172.21.15.29:0/1695835655 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f163659c640 1 --2- 172.21.15.29:0/1695835655 >> v2:172.21.15.29:3300/0 conn(0x7f16380b4380 0x7f16380a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f163659c640 10 monclient(hunting): get_auth_request con 0x7f16380b4380 auth_method 0 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f163659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f163659c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f163659c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f1636d9d640 10 monclient(hunting): get_auth_request con 0x7f1638141770 auth_method 0 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f1636d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f1636d9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f1636d9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f163659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:30.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f163659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:30.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.287+0000 7f163659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:30.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.288+0000 7f1636d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:30.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.288+0000 7f1636d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:30.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.288+0000 7f1636d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:30.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.289+0000 7f1636d9d640 10 monclient(hunting): handle_auth_done global_id 4355 payload 274 2024-04-09T12:05:30.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.289+0000 7f1636d9d640 1 -- 172.21.15.29:0/1695835655 >> v2:172.21.15.29:3300/0 conn(0x7f16380b4380 msgr2=0x7f16380a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:05:30.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.289+0000 7f1636d9d640 1 --2- 172.21.15.29:0/1695835655 >> v2:172.21.15.29:3300/0 conn(0x7f16380b4380 0x7f16380a89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.289+0000 7f1636d9d640 1 -- 172.21.15.29:0/1695835655 >> v1:172.21.15.173:6789/0 conn(0x7f163813e890 legacy=0x7f163813ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.289+0000 7f1636d9d640 10 monclient: _finish_hunting 0 2024-04-09T12:05:30.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.289+0000 7f1636d9d640 1 monclient: found mon.noname-b 2024-04-09T12:05:30.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.289+0000 7f1636d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:30.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.290+0000 7f1636d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:30.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.290+0000 7f1636d9d640 1 -- 172.21.15.29:0/1695835655 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16380aa840 con 0x7f1638141770 2024-04-09T12:05:30.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.291+0000 7f1636d9d640 1 --2- 172.21.15.29:0/1695835655 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1638141770 0x7f1638141c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1630009d90 tx=0x7f163002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbdf37e628243c18 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:30.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 1 -- 172.21.15.29:0/1695835655 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163002cc50 con 0x7f1638141770 2024-04-09T12:05:30.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:30.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:30.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 10 monclient: dump: 2024-04-09T12:05:30.299 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 10 monclient: _finish_auth 0 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 10 monclient: _check_auth_tickets 2024-04-09T12:05:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 1 -- 172.21.15.29:0/1695835655 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163002cdb0 con 0x7f1638141770 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 1 -- 172.21.15.29:0/1695835655 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630034660 con 0x7f1638141770 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163559a640 10 monclient: dump: 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163ce19640 5 monclient: authenticate success, global_id 4355 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163ce19640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.295+0000 7f163ce19640 4 set_mon_vals no callback set 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.296+0000 7f163ce19640 10 monclient: shutdown 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.296+0000 7f163ce19640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.296+0000 7f163ce19640 1 -- 172.21.15.29:0/1695835655 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1638141770 msgr2=0x7f1638141c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.296+0000 7f163ce19640 1 --2- 172.21.15.29:0/1695835655 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1638141770 0x7f1638141c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1630009d90 tx=0x7f163002bea0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.296+0000 7f163ce19640 1 -- 172.21.15.29:0/1695835655 shutdown_connections 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.296+0000 7f163ce19640 1 --2- 172.21.15.29:0/1695835655 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1638141770 0x7f1638141c00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.296+0000 7f163ce19640 1 --2- 172.21.15.29:0/1695835655 >> v2:172.21.15.29:3300/0 conn(0x7f16380b4380 0x7f16380a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.296+0000 7f163ce19640 1 -- 172.21.15.29:0/1695835655 >> 172.21.15.29:0/1695835655 conn(0x7f1638065f30 msgr2=0x7f1638066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:30.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.296+0000 7f163ce19640 1 -- 172.21.15.29:0/1695835655 shutdown_connections 2024-04-09T12:05:30.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.296+0000 7f163ce19640 1 -- 172.21.15.29:0/1695835655 wait complete. 2024-04-09T12:05:30.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.297+0000 7f163ce19640 10 monclient: build_initial_monmap 2024-04-09T12:05:30.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.297+0000 7f163ce19640 10 monclient: monmap: 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.297+0000 7f163ce19640 1 librados: starting msgr at 2024-04-09T12:05:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.297+0000 7f163ce19640 1 librados: starting objecter 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.297+0000 7f163ce19640 1 Processor -- start 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.297+0000 7f163ce19640 1 -- start start 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.297+0000 7f163ce19640 1 librados: setting wanted keys 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.297+0000 7f163ce19640 1 librados: calling monclient init 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.297+0000 7f163ce19640 10 monclient: init 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16380b4380 0x7f1638144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 10 monclient(hunting): picked mon.noname-a con 0x7f16380b4380 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f163813e890 0x7f16380b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 10 monclient(hunting): picked mon.noname-c con 0x7f163813e890 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1638141770 0x7f16381d6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 10 monclient(hunting): picked mon.noname-b con 0x7f1638141770 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1638145a80 con 0x7f16380b4380 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16380b7140 con 0x7f1638141770 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16380b7420 con 0x7f163813e890 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163ce19640 10 monclient(hunting): authenticate will time out at 1396.418465s 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f1635d9b640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f163813e890 0x7f16380b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.298+0000 7f163659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16380b4380 0x7f1638144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1636d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1638141770 0x7f16381d6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1635d9b640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f163813e890 0x7f16380b6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:56296/0 (socket says 172.21.15.29:56296) 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1635d9b640 1 -- 172.21.15.29:0/3571761424 learned_addr learned my addr 172.21.15.29:0/3571761424 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1635d9b640 10 monclient(hunting): get_auth_request con 0x7f163813e890 auth_method 0 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1635d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1635d9b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1635d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f163659c640 10 monclient(hunting): get_auth_request con 0x7f16380b4380 auth_method 0 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f163659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f163659c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f163659c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1636d9d640 10 monclient(hunting): get_auth_request con 0x7f1638141770 auth_method 0 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1636d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1636d9d640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1636d9d640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1636d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1636d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.299+0000 7f1636d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.300+0000 7f1635d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.300+0000 7f1635d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.300+0000 7f1635d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.300+0000 7f163659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.300+0000 7f163659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.300+0000 7f163659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.302+0000 7f1636d9d640 10 monclient(hunting): handle_auth_done global_id 4420 payload 824 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.302+0000 7f1636d9d640 1 -- 172.21.15.29:0/3571761424 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f163813e890 msgr2=0x7f16380b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.302+0000 7f1636d9d640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f163813e890 0x7f16380b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.302+0000 7f1636d9d640 1 -- 172.21.15.29:0/3571761424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16380b4380 msgr2=0x7f1638144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.302+0000 7f1636d9d640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16380b4380 0x7f1638144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.302+0000 7f1636d9d640 10 monclient: _finish_hunting 0 2024-04-09T12:05:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.302+0000 7f1636d9d640 1 monclient: found mon.noname-b 2024-04-09T12:05:30.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.302+0000 7f1636d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:30.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.302+0000 7f1636d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-04-09T12:05:30.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.302+0000 7f1636d9d640 1 -- 172.21.15.29:0/3571761424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1630009a70 con 0x7f1638141770 2024-04-09T12:05:30.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.307+0000 7f1636d9d640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1638141770 0x7f16381d6860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1630033000 tx=0x7f1630004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:30.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.307+0000 7f1626ffd640 10 client.?.objecter ms_handle_connect 0x7f1638141770 2024-04-09T12:05:30.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.307+0000 7f1626ffd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.310+0000 7f1626ffd640 1 -- 172.21.15.29:0/3571761424 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630040650 con 0x7f1638141770 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.310+0000 7f1626ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.310+0000 7f1626ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.310+0000 7f1626ffd640 10 monclient: dump: 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.310+0000 7f1626ffd640 10 monclient: _finish_auth 0 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.310+0000 7f1626ffd640 10 monclient: _check_auth_tickets 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.310+0000 7f1626ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.310+0000 7f1626ffd640 1 -- 172.21.15.29:0/3571761424 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16300407b0 con 0x7f1638141770 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 5 monclient: authenticate success, global_id 4420 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 10 monclient: _renew_subs 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 1 -- 172.21.15.29:0/3571761424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16381d43a0 con 0x7f1638141770 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f1626ffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f1626ffd640 1 -- 172.21.15.29:0/3571761424 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630040b60 con 0x7f1638141770 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f1626ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f1626ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-09T12:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f1626ffd640 10 monclient: dump: 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f1634d99640 4 set_mon_vals no callback set 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 10 client.4420.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 10 monclient: _renew_subs 2024-04-09T12:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 1 -- 172.21.15.29:0/3571761424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16380b7b20 con 0x7f1638141770 2024-04-09T12:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 1 librados: init done 2024-04-09T12:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-04-09T12:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.311+0000 7f163ce19640 1 -- 172.21.15.29:0/3571761424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16380b7640 con 0x7f1638141770 2024-04-09T12:05:30.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.552+0000 7f1626ffd640 1 -- 172.21.15.29:0/3571761424 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1630040cc0 con 0x7f1638141770 2024-04-09T12:05:30.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.553+0000 7f1626ffd640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f161806c5c0 0x7f161806ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:30.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.553+0000 7f163659c640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f161806c5c0 0x7f161806ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:30.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.553+0000 7f163659c640 10 monclient: get_auth_request con 0x7f161806c5c0 auth_method 0 2024-04-09T12:05:30.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.553+0000 7f163659c640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f161806c5c0 0x7f161806ea80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1628009aa0 tx=0x7f1628009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:30.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.553+0000 7f1626ffd640 10 client.4420.objecter ms_handle_connect 0x7f161806c5c0 2024-04-09T12:05:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.555+0000 7f1626ffd640 1 -- 172.21.15.29:0/3571761424 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f163007b410 con 0x7f1638141770 2024-04-09T12:05:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.555+0000 7f1626ffd640 10 client.4420.objecter ms_dispatch 0x7f1638000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.555+0000 7f1626ffd640 3 client.4420.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.555+0000 7f1626ffd640 3 client.4420.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.555+0000 7f1626ffd640 20 client.4420.objecter dump_active .. 0 homeless 2024-04-09T12:05:30.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.568+0000 7f1626ffd640 1 -- 172.21.15.29:0/3571761424 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7f1630077750 con 0x7f1638141770 2024-04-09T12:05:30.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.568+0000 7f1626ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:30.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.568+0000 7f1626ffd640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:30.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.748+0000 7f163ce19640 1 -- 172.21.15.29:0/3571761424 --> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f163814c020 con 0x7f161806c5c0 2024-04-09T12:05:30.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.750+0000 7f1626ffd640 1 -- 172.21.15.29:0/3571761424 <== mgr.4105 v2:172.21.15.173:6800/34987 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47996 (secure 0 0 0) 0x7f1628011a00 con 0x7f161806c5c0 2024-04-09T12:05:30.753 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:05:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-09T12:05:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 10 librados: watch_flush enter 2024-04-09T12:05:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 10 librados: watch_flush exit 2024-04-09T12:05:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 20 client.4420.objecter shutdown clearing up homeless session... 2024-04-09T12:05:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 10 client.4420.objecter successfully canceled tick 2024-04-09T12:05:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 -- 172.21.15.29:0/3571761424 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f161806c5c0 msgr2=0x7f161806ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f161806c5c0 0x7f161806ea80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1628009aa0 tx=0x7f1628009190 comp rx=0 tx=0).stop 2024-04-09T12:05:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 10 monclient: shutdown 2024-04-09T12:05:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 -- 172.21.15.29:0/3571761424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1638141770 msgr2=0x7f16381d6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1638141770 0x7f16381d6860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1630033000 tx=0x7f1630004a40 comp rx=0 tx=0).stop 2024-04-09T12:05:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 -- 172.21.15.29:0/3571761424 shutdown_connections 2024-04-09T12:05:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7f161806c5c0 0x7f161806ea80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1638141770 0x7f16381d6860 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f163813e890 0x7f16380b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 --2- 172.21.15.29:0/3571761424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16380b4380 0x7f1638144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 -- 172.21.15.29:0/3571761424 >> 172.21.15.29:0/3571761424 conn(0x7f1638065f30 msgr2=0x7f16380b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 -- 172.21.15.29:0/3571761424 shutdown_connections 2024-04-09T12:05:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 -- 172.21.15.29:0/3571761424 wait complete. 2024-04-09T12:05:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.752+0000 7f163ce19640 1 librados: shutdown 2024-04-09T12:05:30.767 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-09T12:05:30.103039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218864,"kb_used_data":2672,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755856,"statfs":{"total":773094113280,"available":772869996544,"internally_reserved":0,"allocated":2736128,"data_stored":1489992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001468"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:24.141816+0000","last_change":"2024-04-09T12:05:23.022966+0000","last_active":"2024-04-09T12:05:24.141816+0000","last_peered":"2024-04-09T12:05:24.141816+0000","last_clean":"2024-04-09T12:05:24.141816+0000","last_became_active":"2024-04-09T12:05:23.017267+0000","last_became_peered":"2024-04-09T12:05:23.017267+0000","last_unstale":"2024-04-09T12:05:24.141816+0000","last_undegraded":"2024-04-09T12:05:24.141816+0000","last_fullsized":"2024-04-09T12:05:24.141816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T22:37:43.270719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:23.684624+0000","last_change":"2024-04-09T12:05:23.052602+0000","last_active":"2024-04-09T12:05:23.684624+0000","last_peered":"2024-04-09T12:05:23.684624+0000","last_clean":"2024-04-09T12:05:23.684624+0000","last_became_active":"2024-04-09T12:05:23.026744+0000","last_became_peered":"2024-04-09T12:05:23.026744+0000","last_unstale":"2024-04-09T12:05:23.684624+0000","last_undegraded":"2024-04-09T12:05:23.684624+0000","last_fullsized":"2024-04-09T12:05:23.684624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T19:32:40.384406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:24.138759+0000","last_change":"2024-04-09T12:05:22.555459+0000","last_active":"2024-04-09T12:05:24.138759+0000","last_peered":"2024-04-09T12:05:24.138759+0000","last_clean":"2024-04-09T12:05:24.138759+0000","last_became_active":"2024-04-09T12:05:22.550076+0000","last_became_peered":"2024-04-09T12:05:22.550076+0000","last_unstale":"2024-04-09T12:05:24.138759+0000","last_undegraded":"2024-04-09T12:05:24.138759+0000","last_fullsized":"2024-04-09T12:05:24.138759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T16:08:46.090853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:23.633630+0000","last_change":"2024-04-09T12:05:22.658576+0000","last_active":"2024-04-09T12:05:23.633630+0000","last_peered":"2024-04-09T12:05:23.633630+0000","last_clean":"2024-04-09T12:05:23.633630+0000","last_became_active":"2024-04-09T12:05:22.644424+0000","last_became_peered":"2024-04-09T12:05:22.644424+0000","last_unstale":"2024-04-09T12:05:23.633630+0000","last_undegraded":"2024-04-09T12:05:23.633630+0000","last_fullsized":"2024-04-09T12:05:23.633630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T16:31:46.769142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:24.130361+0000","last_change":"2024-04-09T12:05:22.634268+0000","last_active":"2024-04-09T12:05:24.130361+0000","last_peered":"2024-04-09T12:05:24.130361+0000","last_clean":"2024-04-09T12:05:24.130361+0000","last_became_active":"2024-04-09T12:05:22.628438+0000","last_became_peered":"2024-04-09T12:05:22.628438+0000","last_unstale":"2024-04-09T12:05:24.130361+0000","last_undegraded":"2024-04-09T12:05:24.130361+0000","last_fullsized":"2024-04-09T12:05:24.130361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T16:03:52.875243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-09T12:05:23.427742+0000","last_change":"2024-04-09T12:05:22.464910+0000","last_active":"2024-04-09T12:05:23.427742+0000","last_peered":"2024-04-09T12:05:23.427742+0000","last_clean":"2024-04-09T12:05:23.427742+0000","last_became_active":"2024-04-09T12:05:22.435074+0000","last_became_peered":"2024-04-09T12:05:22.435074+0000","last_unstale":"2024-04-09T12:05:23.427742+0000","last_undegraded":"2024-04-09T12:05:23.427742+0000","last_fullsized":"2024-04-09T12:05:23.427742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T18:36:03.006393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:24.132446+0000","last_change":"2024-04-09T12:05:22.524838+0000","last_active":"2024-04-09T12:05:24.132446+0000","last_peered":"2024-04-09T12:05:24.132446+0000","last_clean":"2024-04-09T12:05:24.132446+0000","last_became_active":"2024-04-09T12:05:22.496207+0000","last_became_peered":"2024-04-09T12:05:22.496207+0000","last_unstale":"2024-04-09T12:05:24.132446+0000","last_undegraded":"2024-04-09T12:05:24.132446+0000","last_fullsized":"2024-04-09T12:05:24.132446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T23:46:47.072566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:24.147379+0000","last_change":"2024-04-09T12:05:22.996256+0000","last_active":"2024-04-09T12:05:24.147379+0000","last_peered":"2024-04-09T12:05:24.147379+0000","last_clean":"2024-04-09T12:05:24.147379+0000","last_became_active":"2024-04-09T12:05:22.990747+0000","last_became_peered":"2024-04-09T12:05:22.990747+0000","last_unstale":"2024-04-09T12:05:24.147379+0000","last_undegraded":"2024-04-09T12:05:24.147379+0000","last_fullsized":"2024-04-09T12:05:24.147379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T12:44:51.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'76","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-09T12:05:22.658502+0000","last_change":"2024-04-09T12:05:17.887811+0000","last_active":"2024-04-09T12:05:22.658502+0000","last_peered":"2024-04-09T12:05:22.658502+0000","last_clean":"2024-04-09T12:05:22.658502+0000","last_became_active":"2024-04-09T12:05:17.255307+0000","last_became_peered":"2024-04-09T12:05:17.255307+0000","last_unstale":"2024-04-09T12:05:22.658502+0000","last_undegraded":"2024-04-09T12:05:22.658502+0000","last_fullsized":"2024-04-09T12:05:22.658502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:05.061432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:05.061432+0000","last_clean_scrub_stamp":"2024-04-09T12:05:05.061432+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-11T00:02:20.630741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":21,"seq":90194313225,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":484629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.8810000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0709999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.913}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.252000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.597}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.068999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.624000000000001}]}]},{"osd":4,"up_from":20,"seq":85899345931,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.742}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.2309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.646000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8659999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.885}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.413}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.670999999999999}]}]},{"osd":7,"up_from":19,"seq":81604378634,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.349}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.459}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.577000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.787000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.632}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.731}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3079999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.471}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.048999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.774999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.620000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.917999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.4000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.153}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.625999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.561999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.912000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.166}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.484000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.243}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":22.030999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":22.713000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.448}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.256}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.974}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.556000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.777000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.875999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.923}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.076000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.227}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":484629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.4800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.367000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.388000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.055}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.231000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":84.658000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-09T12:05:30.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-09T12:05:30.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.868+0000 7fe6dec8f640 10 monclient: get_monmap_and_config 2024-04-09T12:05:30.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.868+0000 7fe6dec8f640 10 monclient: build_initial_monmap 2024-04-09T12:05:30.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.868+0000 7fe6dec8f640 10 monclient: monmap: 2024-04-09T12:05:30.871 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:30.871 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:30.872 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:30.870136+0000 2024-04-09T12:05:30.872 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:30.870136+0000 2024-04-09T12:05:30.872 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:30.872 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.872 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:30.872 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:30.872 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:30.872 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:30.872 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:30.872 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.869+0000 7fe6dec8f640 1 Processor -- start 2024-04-09T12:05:30.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.869+0000 7fe6dec8f640 1 -- start start 2024-04-09T12:05:30.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.869+0000 7fe6dec8f640 10 monclient: init 2024-04-09T12:05:30.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.869+0000 7fe6dec8f640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:30.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.869+0000 7fe6dec8f640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.869+0000 7fe6dec8f640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d80addf0 0x7fe6d813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.869+0000 7fe6dec8f640 10 monclient(hunting): picked mon.noname-b con 0x7fe6d80addf0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.869+0000 7fe6dec8f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe6d806fef0 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.870+0000 7fe6dec8f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe6d8071d60 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.870+0000 7fe6dec8f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d806fb30 con 0x7fe6d806fef0 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.870+0000 7fe6dec8f640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d806ed30 con 0x7fe6d8071d60 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.870+0000 7fe6dec8f640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.870+0000 7fe6dec8f640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80af7f0 con 0x7fe6d80addf0 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.870+0000 7fe6dec8f640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.870+0000 7fe6dec8f640 10 monclient(hunting): authenticate will time out at 1396.990051s 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.870+0000 7fe6dca2b640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d80addf0 0x7fe6d813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:30.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.870+0000 7fe6dd22c640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe6d8071d60 0x7fe6d8148cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:37952/0 (socket says 172.21.15.29:37952) 2024-04-09T12:05:30.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.870+0000 7fe6dd22c640 1 -- 172.21.15.29:0/281849146 learned_addr learned my addr 172.21.15.29:0/281849146 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:30.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.871+0000 7fe6dca2b640 10 monclient(hunting): get_auth_request con 0x7fe6d80addf0 auth_method 0 2024-04-09T12:05:30.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.871+0000 7fe6dca2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:30.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.871+0000 7fe6dca2b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:30.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.871+0000 7fe6dca2b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:30.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.871+0000 7fe6dca2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:30.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.871+0000 7fe6dca2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:30.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.871+0000 7fe6dca2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:30.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 1 -- 172.21.15.29:0/281849146 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353626083 0 0) 0x7fe6d806fb30 con 0x7fe6d806fef0 2024-04-09T12:05:30.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 10 monclient(hunting): _negotiate 2024-04-09T12:05:30.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:30.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:30.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 10 monclient(hunting): my global_id is 4380 2024-04-09T12:05:30.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 1 -- 172.21.15.29:0/281849146 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c8005730 con 0x7fe6d806fef0 2024-04-09T12:05:30.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 1 -- 172.21.15.29:0/281849146 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868396245 0 0) 0x7fe6d806ed30 con 0x7fe6d8071d60 2024-04-09T12:05:30.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 10 monclient(hunting): _negotiate 2024-04-09T12:05:30.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:30.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:30.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 10 monclient(hunting): my global_id is 4423 2024-04-09T12:05:30.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6d77fe640 1 -- 172.21.15.29:0/281849146 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d806fb30 con 0x7fe6d8071d60 2024-04-09T12:05:30.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6dca2b640 10 monclient(hunting): handle_auth_done global_id 4361 payload 274 2024-04-09T12:05:30.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6dca2b640 1 -- 172.21.15.29:0/281849146 >> v1:172.21.15.173:6789/0 conn(0x7fe6d8071d60 legacy=0x7fe6d8148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6dca2b640 1 -- 172.21.15.29:0/281849146 >> v1:172.21.15.29:6789/0 conn(0x7fe6d806fef0 legacy=0x7fe6d8071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6dca2b640 10 monclient: _finish_hunting 0 2024-04-09T12:05:30.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6dca2b640 1 monclient: found mon.noname-b 2024-04-09T12:05:30.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6dca2b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:30.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6dca2b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:30.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.873+0000 7fe6dca2b640 1 -- 172.21.15.29:0/281849146 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d80ad510 con 0x7fe6d80addf0 2024-04-09T12:05:30.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.876+0000 7fe6dca2b640 1 --2- 172.21.15.29:0/281849146 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d80addf0 0x7fe6d813b630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0097d0 tx=0x7fe6cc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6faaaf6c9f4eb58 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:30.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 1 -- 172.21.15.29:0/281849146 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc02d040 con 0x7fe6d80addf0 2024-04-09T12:05:30.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:30.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:30.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 10 monclient: dump: 2024-04-09T12:05:30.883 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:30.883 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:30.883 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.883 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 10 monclient: _finish_auth 0 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 10 monclient: _check_auth_tickets 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 1 -- 172.21.15.29:0/281849146 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc031810 con 0x7fe6d80addf0 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6dec8f640 5 monclient: authenticate success, global_id 4361 2024-04-09T12:05:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6dec8f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6dec8f640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6dec8f640 4 set_mon_vals no callback set 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 1 -- 172.21.15.29:0/281849146 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc031ba0 con 0x7fe6d80addf0 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.880+0000 7fe6d77fe640 10 monclient: dump: 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:30.886 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.881+0000 7fe6dec8f640 10 monclient: shutdown 2024-04-09T12:05:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.881+0000 7fe6dec8f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.881+0000 7fe6dec8f640 1 -- 172.21.15.29:0/281849146 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d80addf0 msgr2=0x7fe6d813b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.881+0000 7fe6dec8f640 1 --2- 172.21.15.29:0/281849146 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d80addf0 0x7fe6d813b630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0097d0 tx=0x7fe6cc02b8b0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.881+0000 7fe6dec8f640 1 -- 172.21.15.29:0/281849146 shutdown_connections 2024-04-09T12:05:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.881+0000 7fe6dec8f640 1 --2- 172.21.15.29:0/281849146 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d80addf0 0x7fe6d813b630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.881+0000 7fe6dec8f640 1 -- 172.21.15.29:0/281849146 >> 172.21.15.29:0/281849146 conn(0x7fe6d80b3120 msgr2=0x7fe6d80b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.881+0000 7fe6dec8f640 1 -- 172.21.15.29:0/281849146 shutdown_connections 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.881+0000 7fe6dec8f640 1 -- 172.21.15.29:0/281849146 wait complete. 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.881+0000 7fe6dec8f640 10 monclient: build_initial_monmap 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.881+0000 7fe6dec8f640 10 monclient: monmap: 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.882+0000 7fe6dec8f640 1 librados: starting msgr at 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.882+0000 7fe6dec8f640 1 librados: starting objecter 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.882+0000 7fe6dec8f640 1 Processor -- start 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.882+0000 7fe6dec8f640 1 -- start start 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.882+0000 7fe6dec8f640 1 librados: setting wanted keys 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.882+0000 7fe6dec8f640 1 librados: calling monclient init 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.882+0000 7fe6dec8f640 10 monclient: init 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:05:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6d806fef0 0x7fe6d813edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 10 monclient(hunting): picked mon.noname-b con 0x7fe6d806fef0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d8071d60 0x7fe6d8136220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 10 monclient(hunting): picked mon.noname-c con 0x7fe6d8071d60 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d80addf0 0x7fe6d8136760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 10 monclient(hunting): picked mon.noname-a con 0x7fe6d80addf0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80a8ea0 con 0x7fe6d80addf0 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8136ca0 con 0x7fe6d806fef0 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d813df80 con 0x7fe6d8071d60 2024-04-09T12:05:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dec8f640 10 monclient(hunting): authenticate will time out at 1397.003239s 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dca2b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6d806fef0 0x7fe6d813edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6dd22c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d80addf0 0x7fe6d8136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.883+0000 7fe6d7fff640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d8071d60 0x7fe6d8136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dca2b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6d806fef0 0x7fe6d813edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:46832/0 (socket says 172.21.15.29:46832) 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dca2b640 1 -- 172.21.15.29:0/2711228862 learned_addr learned my addr 172.21.15.29:0/2711228862 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dca2b640 10 monclient(hunting): get_auth_request con 0x7fe6d806fef0 auth_method 0 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dca2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dca2b640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dca2b640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6d7fff640 10 monclient(hunting): get_auth_request con 0x7fe6d8071d60 auth_method 0 2024-04-09T12:05:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6d7fff640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dd22c640 10 monclient(hunting): get_auth_request con 0x7fe6d80addf0 auth_method 0 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dd22c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dd22c640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dd22c640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dd22c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dd22c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dd22c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dca2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dca2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.884+0000 7fe6dca2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.887+0000 7fe6dd22c640 10 monclient(hunting): handle_auth_done global_id 4383 payload 824 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.887+0000 7fe6dd22c640 1 -- 172.21.15.29:0/2711228862 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d8071d60 msgr2=0x7fe6d8136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.887+0000 7fe6dd22c640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d8071d60 0x7fe6d8136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.887+0000 7fe6dd22c640 1 -- 172.21.15.29:0/2711228862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6d806fef0 msgr2=0x7fe6d813edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.887+0000 7fe6dd22c640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6d806fef0 0x7fe6d813edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.887+0000 7fe6dd22c640 10 monclient: _finish_hunting 0 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.887+0000 7fe6dd22c640 1 monclient: found mon.noname-a 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.887+0000 7fe6dd22c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.887+0000 7fe6dd22c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:05:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.887+0000 7fe6dd22c640 1 -- 172.21.15.29:0/2711228862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc009400 con 0x7fe6d80addf0 2024-04-09T12:05:30.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.887+0000 7fe6d7fff640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d8071d60 0x7fe6d8136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-09T12:05:30.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.889+0000 7fe6dd22c640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d80addf0 0x7fe6d8136760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000ca80 tx=0x7fe6d000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:30.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.889+0000 7fe6d57fa640 10 client.?.objecter ms_handle_connect 0x7fe6d80addf0 2024-04-09T12:05:30.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.890+0000 7fe6d57fa640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:30.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 1 -- 172.21.15.29:0/2711228862 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000ac30 con 0x7fe6d80addf0 2024-04-09T12:05:30.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:30.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:05:30.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 10 monclient: dump: 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 10 monclient: _finish_auth 0 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 10 monclient: _check_auth_tickets 2024-04-09T12:05:30.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:30.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 1 -- 172.21.15.29:0/2711228862 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d000ad90 con 0x7fe6d80addf0 2024-04-09T12:05:30.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:30.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 1 -- 172.21.15.29:0/2711228862 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0012600 con 0x7fe6d80addf0 2024-04-09T12:05:30.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6dec8f640 5 monclient: authenticate success, global_id 4383 2024-04-09T12:05:30.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6dec8f640 10 monclient: _renew_subs 2024-04-09T12:05:30.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6dec8f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:30.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6dec8f640 1 -- 172.21.15.29:0/2711228862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d813f300 con 0x7fe6d80addf0 2024-04-09T12:05:30.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d6ffd640 4 set_mon_vals no callback set 2024-04-09T12:05:30.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:30.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:05:30.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6d57fa640 10 monclient: dump: 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6dec8f640 10 client.4383.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6dec8f640 10 monclient: _renew_subs 2024-04-09T12:05:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6dec8f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:30.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6dec8f640 1 -- 172.21.15.29:0/2711228862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d80a8b10 con 0x7fe6d80addf0 2024-04-09T12:05:30.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.893+0000 7fe6dec8f640 1 librados: init done 2024-04-09T12:05:30.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.894+0000 7fe6dec8f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:30.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.894+0000 7fe6dec8f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:30.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.894+0000 7fe6dec8f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:05:30.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.894+0000 7fe6dec8f640 1 -- 172.21.15.29:0/2711228862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d80a9e20 con 0x7fe6d80addf0 2024-04-09T12:05:30.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.912+0000 7fe6d57fa640 1 -- 172.21.15.29:0/2711228862 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe6d0007070 con 0x7fe6d80addf0 2024-04-09T12:05:30.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.913+0000 7fe6d57fa640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6bc06c5e0 0x7fe6bc06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:30.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.913+0000 7fe6dca2b640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6bc06c5e0 0x7fe6bc06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:30.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.913+0000 7fe6dca2b640 10 monclient: get_auth_request con 0x7fe6bc06c5e0 auth_method 0 2024-04-09T12:05:30.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.914+0000 7fe6dca2b640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6bc06c5e0 0x7fe6bc06eaa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009720 tx=0x7fe6cc03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:30.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:30.914+0000 7fe6d57fa640 10 client.4383.objecter ms_handle_connect 0x7fe6bc06c5e0 2024-04-09T12:05:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.180+0000 7fe6d57fa640 1 -- 172.21.15.29:0/2711228862 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe6d00586b0 con 0x7fe6d80addf0 2024-04-09T12:05:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.181+0000 7fe6d57fa640 10 client.4383.objecter ms_dispatch 0x7fe6d8000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.181+0000 7fe6d57fa640 3 client.4383.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.181+0000 7fe6d57fa640 3 client.4383.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.181+0000 7fe6d57fa640 20 client.4383.objecter dump_active .. 0 homeless 2024-04-09T12:05:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.181+0000 7fe6d57fa640 1 -- 172.21.15.29:0/2711228862 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7fe6d00549f0 con 0x7fe6d80addf0 2024-04-09T12:05:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.181+0000 7fe6d57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.181+0000 7fe6d57fa640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:31.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.409+0000 7fe6dec8f640 1 -- 172.21.15.29:0/2711228862 --> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6d80aa1f0 con 0x7fe6bc06c5e0 2024-04-09T12:05:31.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.411+0000 7fe6d57fa640 1 -- 172.21.15.29:0/2711228862 <== mgr.4105 v2:172.21.15.173:6800/34987 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47996 (secure 0 0 0) 0x7fe6d80aa1f0 con 0x7fe6bc06c5e0 2024-04-09T12:05:31.415 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:05:31.415 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-09T12:05:31.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 10 librados: watch_flush enter 2024-04-09T12:05:31.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 10 librados: watch_flush exit 2024-04-09T12:05:31.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 20 client.4383.objecter shutdown clearing up homeless session... 2024-04-09T12:05:31.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 10 client.4383.objecter successfully canceled tick 2024-04-09T12:05:31.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 -- 172.21.15.29:0/2711228862 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6bc06c5e0 msgr2=0x7fe6bc06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:31.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6bc06c5e0 0x7fe6bc06eaa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009720 tx=0x7fe6cc03c040 comp rx=0 tx=0).stop 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 10 monclient: shutdown 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 -- 172.21.15.29:0/2711228862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d80addf0 msgr2=0x7fe6d8136760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d80addf0 0x7fe6d8136760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000ca80 tx=0x7fe6d000cf40 comp rx=0 tx=0).stop 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 -- 172.21.15.29:0/2711228862 shutdown_connections 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fe6bc06c5e0 0x7fe6bc06eaa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d80addf0 0x7fe6d8136760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6d8071d60 0x7fe6d8136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 --2- 172.21.15.29:0/2711228862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6d806fef0 0x7fe6d813edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 -- 172.21.15.29:0/2711228862 >> 172.21.15.29:0/2711228862 conn(0x7fe6d80b3120 msgr2=0x7fe6d8071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 -- 172.21.15.29:0/2711228862 shutdown_connections 2024-04-09T12:05:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 -- 172.21.15.29:0/2711228862 wait complete. 2024-04-09T12:05:31.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.414+0000 7fe6dec8f640 1 librados: shutdown 2024-04-09T12:05:31.427 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-09T12:05:30.103039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218864,"kb_used_data":2672,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755856,"statfs":{"total":773094113280,"available":772869996544,"internally_reserved":0,"allocated":2736128,"data_stored":1489992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001468"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:24.141816+0000","last_change":"2024-04-09T12:05:23.022966+0000","last_active":"2024-04-09T12:05:24.141816+0000","last_peered":"2024-04-09T12:05:24.141816+0000","last_clean":"2024-04-09T12:05:24.141816+0000","last_became_active":"2024-04-09T12:05:23.017267+0000","last_became_peered":"2024-04-09T12:05:23.017267+0000","last_unstale":"2024-04-09T12:05:24.141816+0000","last_undegraded":"2024-04-09T12:05:24.141816+0000","last_fullsized":"2024-04-09T12:05:24.141816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T22:37:43.270719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:23.684624+0000","last_change":"2024-04-09T12:05:23.052602+0000","last_active":"2024-04-09T12:05:23.684624+0000","last_peered":"2024-04-09T12:05:23.684624+0000","last_clean":"2024-04-09T12:05:23.684624+0000","last_became_active":"2024-04-09T12:05:23.026744+0000","last_became_peered":"2024-04-09T12:05:23.026744+0000","last_unstale":"2024-04-09T12:05:23.684624+0000","last_undegraded":"2024-04-09T12:05:23.684624+0000","last_fullsized":"2024-04-09T12:05:23.684624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T19:32:40.384406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:24.138759+0000","last_change":"2024-04-09T12:05:22.555459+0000","last_active":"2024-04-09T12:05:24.138759+0000","last_peered":"2024-04-09T12:05:24.138759+0000","last_clean":"2024-04-09T12:05:24.138759+0000","last_became_active":"2024-04-09T12:05:22.550076+0000","last_became_peered":"2024-04-09T12:05:22.550076+0000","last_unstale":"2024-04-09T12:05:24.138759+0000","last_undegraded":"2024-04-09T12:05:24.138759+0000","last_fullsized":"2024-04-09T12:05:24.138759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T16:08:46.090853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:23.633630+0000","last_change":"2024-04-09T12:05:22.658576+0000","last_active":"2024-04-09T12:05:23.633630+0000","last_peered":"2024-04-09T12:05:23.633630+0000","last_clean":"2024-04-09T12:05:23.633630+0000","last_became_active":"2024-04-09T12:05:22.644424+0000","last_became_peered":"2024-04-09T12:05:22.644424+0000","last_unstale":"2024-04-09T12:05:23.633630+0000","last_undegraded":"2024-04-09T12:05:23.633630+0000","last_fullsized":"2024-04-09T12:05:23.633630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T16:31:46.769142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:24.130361+0000","last_change":"2024-04-09T12:05:22.634268+0000","last_active":"2024-04-09T12:05:24.130361+0000","last_peered":"2024-04-09T12:05:24.130361+0000","last_clean":"2024-04-09T12:05:24.130361+0000","last_became_active":"2024-04-09T12:05:22.628438+0000","last_became_peered":"2024-04-09T12:05:22.628438+0000","last_unstale":"2024-04-09T12:05:24.130361+0000","last_undegraded":"2024-04-09T12:05:24.130361+0000","last_fullsized":"2024-04-09T12:05:24.130361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T16:03:52.875243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-09T12:05:23.427742+0000","last_change":"2024-04-09T12:05:22.464910+0000","last_active":"2024-04-09T12:05:23.427742+0000","last_peered":"2024-04-09T12:05:23.427742+0000","last_clean":"2024-04-09T12:05:23.427742+0000","last_became_active":"2024-04-09T12:05:22.435074+0000","last_became_peered":"2024-04-09T12:05:22.435074+0000","last_unstale":"2024-04-09T12:05:23.427742+0000","last_undegraded":"2024-04-09T12:05:23.427742+0000","last_fullsized":"2024-04-09T12:05:23.427742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T18:36:03.006393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:24.132446+0000","last_change":"2024-04-09T12:05:22.524838+0000","last_active":"2024-04-09T12:05:24.132446+0000","last_peered":"2024-04-09T12:05:24.132446+0000","last_clean":"2024-04-09T12:05:24.132446+0000","last_became_active":"2024-04-09T12:05:22.496207+0000","last_became_peered":"2024-04-09T12:05:22.496207+0000","last_unstale":"2024-04-09T12:05:24.132446+0000","last_undegraded":"2024-04-09T12:05:24.132446+0000","last_fullsized":"2024-04-09T12:05:24.132446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T23:46:47.072566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-09T12:05:24.147379+0000","last_change":"2024-04-09T12:05:22.996256+0000","last_active":"2024-04-09T12:05:24.147379+0000","last_peered":"2024-04-09T12:05:24.147379+0000","last_clean":"2024-04-09T12:05:24.147379+0000","last_became_active":"2024-04-09T12:05:22.990747+0000","last_became_peered":"2024-04-09T12:05:22.990747+0000","last_unstale":"2024-04-09T12:05:24.147379+0000","last_undegraded":"2024-04-09T12:05:24.147379+0000","last_fullsized":"2024-04-09T12:05:24.147379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:20.935223+0000","last_clean_scrub_stamp":"2024-04-09T12:05:20.935223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-10T12:44:51.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'76","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-09T12:05:22.658502+0000","last_change":"2024-04-09T12:05:17.887811+0000","last_active":"2024-04-09T12:05:22.658502+0000","last_peered":"2024-04-09T12:05:22.658502+0000","last_clean":"2024-04-09T12:05:22.658502+0000","last_became_active":"2024-04-09T12:05:17.255307+0000","last_became_peered":"2024-04-09T12:05:17.255307+0000","last_unstale":"2024-04-09T12:05:22.658502+0000","last_undegraded":"2024-04-09T12:05:22.658502+0000","last_fullsized":"2024-04-09T12:05:22.658502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-09T12:05:05.061432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-09T12:05:05.061432+0000","last_clean_scrub_stamp":"2024-04-09T12:05:05.061432+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-11T00:02:20.630741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":21,"seq":90194313225,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":484629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.8810000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0709999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.913}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.252000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.597}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.068999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.624000000000001}]}]},{"osd":4,"up_from":20,"seq":85899345931,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.742}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.2309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.646000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8659999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.885}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.413}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.670999999999999}]}]},{"osd":7,"up_from":19,"seq":81604378634,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.349}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.459}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.577000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.787000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.632}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.731}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3079999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.471}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.048999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.774999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.620000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.917999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.4000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.153}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.625999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.561999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.912000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.166}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.484000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.243}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":22.030999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":22.713000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.448}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.256}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":86789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.974}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.556000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.777000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.875999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.923}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.076000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.227}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":484629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.4800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.367000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.388000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.055}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.231000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":84.658000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-09T12:05:31.428 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-09T12:05:31.428 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-09T12:05:31.429 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-09T12:05:31.429 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-09T12:05:31.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.531+0000 7ff6dfea4640 10 monclient: get_monmap_and_config 2024-04-09T12:05:31.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.531+0000 7ff6dfea4640 10 monclient: build_initial_monmap 2024-04-09T12:05:31.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.531+0000 7ff6dfea4640 10 monclient: monmap: 2024-04-09T12:05:31.534 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:31.534 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:31.535 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:05:31.533177+0000 2024-04-09T12:05:31.535 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:05:31.533177+0000 2024-04-09T12:05:31.535 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:31.535 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:31.535 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T12:05:31.535 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T12:05:31.535 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T12:05:31.535 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T12:05:31.535 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T12:05:31.535 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.532+0000 7ff6dfea4640 1 Processor -- start 2024-04-09T12:05:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.532+0000 7ff6dfea4640 1 -- start start 2024-04-09T12:05:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.532+0000 7ff6dfea4640 10 monclient: init 2024-04-09T12:05:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.532+0000 7ff6dfea4640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.532+0000 7ff6dfea4640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2024-04-09T12:05:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.532+0000 7ff6dfea4640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 0x7ff6d8141640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:31.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.532+0000 7ff6dfea4640 10 monclient(hunting): picked mon.noname-b con 0x7ff6d80b43e0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:31.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.533+0000 7ff6dfea4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff6d80b0d90 addr v1:172.21.15.173:6789/0 2024-04-09T12:05:31.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.533+0000 7ff6dfea4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff6d813e420 addr v1:172.21.15.29:6789/0 2024-04-09T12:05:31.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.533+0000 7ff6dfea4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80a87a0 con 0x7ff6d813e420 2024-04-09T12:05:31.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.533+0000 7ff6dfea4640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80a8a80 con 0x7ff6d80b0d90 2024-04-09T12:05:31.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.533+0000 7ff6dfea4640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:31.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.533+0000 7ff6dfea4640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80a9620 con 0x7ff6d80b43e0 2024-04-09T12:05:31.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.533+0000 7ff6dfea4640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:31.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.533+0000 7ff6dfea4640 10 monclient(hunting): authenticate will time out at 1397.653034s 2024-04-09T12:05:31.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.533+0000 7ff6ddc40640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 0x7ff6d8141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:31.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.533+0000 7ff6de441640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff6d813e420 0x7ff6d813e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33136/0 (socket says 172.21.15.29:33136) 2024-04-09T12:05:31.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.533+0000 7ff6de441640 1 -- 172.21.15.29:0/3677867132 learned_addr learned my addr 172.21.15.29:0/3677867132 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-09T12:05:31.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.534+0000 7ff6ddc40640 10 monclient(hunting): get_auth_request con 0x7ff6d80b43e0 auth_method 0 2024-04-09T12:05:31.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.534+0000 7ff6ddc40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:31.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.534+0000 7ff6ddc40640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:31.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.534+0000 7ff6ddc40640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:31.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.534+0000 7ff6ddc40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:31.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.534+0000 7ff6ddc40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:31.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.534+0000 7ff6ddc40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:31.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.535+0000 7ff6dcc3e640 1 -- 172.21.15.29:0/3677867132 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635743602 0 0) 0x7ff6d80a87a0 con 0x7ff6d813e420 2024-04-09T12:05:31.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.535+0000 7ff6dcc3e640 10 monclient(hunting): _negotiate 2024-04-09T12:05:31.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.535+0000 7ff6dcc3e640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:31.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.535+0000 7ff6dcc3e640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:31.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.535+0000 7ff6dcc3e640 10 monclient(hunting): my global_id is 4386 2024-04-09T12:05:31.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.535+0000 7ff6dcc3e640 1 -- 172.21.15.29:0/3677867132 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6c4003520 con 0x7ff6d813e420 2024-04-09T12:05:31.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.536+0000 7ff6ddc40640 10 monclient(hunting): handle_auth_done global_id 4367 payload 274 2024-04-09T12:05:31.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.536+0000 7ff6ddc40640 1 -- 172.21.15.29:0/3677867132 >> v1:172.21.15.173:6789/0 conn(0x7ff6d80b0d90 legacy=0x7ff6d80a8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:31.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.536+0000 7ff6ddc40640 1 -- 172.21.15.29:0/3677867132 >> v1:172.21.15.29:6789/0 conn(0x7ff6d813e420 legacy=0x7ff6d813e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:31.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.536+0000 7ff6ddc40640 10 monclient: _finish_hunting 0 2024-04-09T12:05:31.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.536+0000 7ff6ddc40640 1 monclient: found mon.noname-b 2024-04-09T12:05:31.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.536+0000 7ff6ddc40640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:31.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.536+0000 7ff6ddc40640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.29:3301/0 2024-04-09T12:05:31.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.536+0000 7ff6ddc40640 1 -- 172.21.15.29:0/3677867132 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d80aa400 con 0x7ff6d80b43e0 2024-04-09T12:05:31.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.538+0000 7ff6ddc40640 1 --2- 172.21.15.29:0/3677867132 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 0x7ff6d8141640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009800 tx=0x7ff6d402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=464f2dcdd754b49e server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:31.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 1 -- 172.21.15.29:0/3677867132 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4031800 con 0x7ff6d80b43e0 2024-04-09T12:05:31.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:31.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-09T12:05:31.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 10 monclient: dump: 2024-04-09T12:05:31.545 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:31.545 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:31.545 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:31.545 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:31.545 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:31.546 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:31.546 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:31.546 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:31.546 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:31.546 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:31.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 10 monclient: _finish_auth 0 2024-04-09T12:05:31.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 10 monclient: _check_auth_tickets 2024-04-09T12:05:31.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:31.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 1 -- 172.21.15.29:0/3677867132 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d4031960 con 0x7ff6d80b43e0 2024-04-09T12:05:31.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dfea4640 5 monclient: authenticate success, global_id 4367 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dfea4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dfea4640 10 monclient: get_monmap_and_config success 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 1 -- 172.21.15.29:0/3677867132 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4031cf0 con 0x7ff6d80b43e0 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dfea4640 4 set_mon_vals no callback set 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.541+0000 7ff6dcc3e640 10 monclient: dump: 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:31.548 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:31.548 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:31.548 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:31.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.542+0000 7ff6dfea4640 10 monclient: shutdown 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.542+0000 7ff6dfea4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.542+0000 7ff6dfea4640 1 -- 172.21.15.29:0/3677867132 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 msgr2=0x7ff6d8141640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.542+0000 7ff6dfea4640 1 --2- 172.21.15.29:0/3677867132 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 0x7ff6d8141640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009800 tx=0x7ff6d402b8a0 comp rx=0 tx=0).stop 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.542+0000 7ff6dfea4640 1 -- 172.21.15.29:0/3677867132 shutdown_connections 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.542+0000 7ff6dfea4640 1 --2- 172.21.15.29:0/3677867132 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 0x7ff6d8141640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.542+0000 7ff6dfea4640 1 -- 172.21.15.29:0/3677867132 >> 172.21.15.29:0/3677867132 conn(0x7ff6d8065f30 msgr2=0x7ff6d8066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.542+0000 7ff6dfea4640 1 -- 172.21.15.29:0/3677867132 shutdown_connections 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.542+0000 7ff6dfea4640 1 -- 172.21.15.29:0/3677867132 wait complete. 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.543+0000 7ff6dfea4640 10 monclient: build_initial_monmap 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.543+0000 7ff6dfea4640 10 monclient: monmap: 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:05:31.552 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 0.000000 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:created 0.000000 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.543+0000 7ff6dfea4640 1 librados: starting msgr at 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.543+0000 7ff6dfea4640 1 librados: starting objecter 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.543+0000 7ff6dfea4640 1 Processor -- start 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.543+0000 7ff6dfea4640 1 -- start start 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.543+0000 7ff6dfea4640 1 librados: setting wanted keys 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.543+0000 7ff6dfea4640 1 librados: calling monclient init 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.543+0000 7ff6dfea4640 10 monclient: init 2024-04-09T12:05:31.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 10 monclient: _reopen_session rank -1 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6d80b0d90 0x7ff6d8139ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 10 monclient(hunting): picked mon.noname-b con 0x7ff6d80b0d90 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 0x7ff6d813a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 10 monclient(hunting): picked mon.noname-c con 0x7ff6d80b43e0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6d813e420 0x7ff6d80afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 10 monclient(hunting): picked mon.noname-a con 0x7ff6d813e420 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80ab1d0 con 0x7ff6d813e420 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d813a760 con 0x7ff6d80b0d90 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 10 monclient(hunting): start opening mon connection 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d8136ff0 con 0x7ff6d80b43e0 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 10 monclient(hunting): _renew_subs 2024-04-09T12:05:31.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dfea4640 10 monclient(hunting): authenticate will time out at 1397.664363s 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6de441640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6d813e420 0x7ff6d80afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6ddc40640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6d80b0d90 0x7ff6d8139ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.544+0000 7ff6dd43f640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 0x7ff6d813a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6dd43f640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 0x7ff6d813a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:56336/0 (socket says 172.21.15.29:56336) 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6dd43f640 1 -- 172.21.15.29:0/1032758693 learned_addr learned my addr 172.21.15.29:0/1032758693 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6dd43f640 10 monclient(hunting): get_auth_request con 0x7ff6d80b43e0 auth_method 0 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6dd43f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6dd43f640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6dd43f640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6ddc40640 10 monclient(hunting): get_auth_request con 0x7ff6d80b0d90 auth_method 0 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6ddc40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6ddc40640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6ddc40640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:31.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6de441640 10 monclient(hunting): get_auth_request con 0x7ff6d813e420 auth_method 0 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6de441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6de441640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6de441640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6dd43f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6dd43f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6dd43f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6ddc40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6ddc40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6ddc40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6de441640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6de441640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.545+0000 7ff6de441640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.548+0000 7ff6dd43f640 10 monclient(hunting): handle_auth_done global_id 4370 payload 824 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.548+0000 7ff6dd43f640 1 -- 172.21.15.29:0/1032758693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6d80b0d90 msgr2=0x7ff6d8139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:31.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.548+0000 7ff6dd43f640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6d80b0d90 0x7ff6d8139ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:31.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.548+0000 7ff6dd43f640 1 -- 172.21.15.29:0/1032758693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6d813e420 msgr2=0x7ff6d80afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:31.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.548+0000 7ff6dd43f640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6d813e420 0x7ff6d80afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:31.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.548+0000 7ff6dd43f640 10 monclient: _finish_hunting 0 2024-04-09T12:05:31.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.548+0000 7ff6dd43f640 1 monclient: found mon.noname-c 2024-04-09T12:05:31.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.548+0000 7ff6dd43f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:05:31.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.548+0000 7ff6dd43f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-04-09T12:05:31.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.548+0000 7ff6dd43f640 1 -- 172.21.15.29:0/1032758693 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d4009400 con 0x7ff6d80b43e0 2024-04-09T12:05:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.550+0000 7ff6dd43f640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 0x7ff6d813a220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800c480 tx=0x7ff6c800c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.550+0000 7ff6ce7fc640 10 client.?.objecter ms_handle_connect 0x7ff6d80b43e0 2024-04-09T12:05:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.550+0000 7ff6ce7fc640 10 client.?.objecter resend_mon_ops 2024-04-09T12:05:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 1 -- 172.21.15.29:0/1032758693 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80052d0 con 0x7ff6d80b43e0 2024-04-09T12:05:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 10 monclient: dump: 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 10 monclient: _finish_auth 0 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 10 monclient: _check_auth_tickets 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:05:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 1 -- 172.21.15.29:0/1032758693 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c8005430 con 0x7ff6d80b43e0 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6dfea4640 5 monclient: authenticate success, global_id 4370 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6dfea4640 10 monclient: _renew_subs 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6dfea4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6dfea4640 1 -- 172.21.15.29:0/1032758693 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d813a940 con 0x7ff6d80b43e0 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 1 -- 172.21.15.29:0/1032758693 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8012870 con 0x7ff6d80b43e0 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6ce7fc640 10 monclient: dump: 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 1 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:05:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 18 (reef) 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6cffff640 4 set_mon_vals no callback set 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6dfea4640 10 client.4370.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6dfea4640 10 monclient: _renew_subs 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6dfea4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6dfea4640 1 -- 172.21.15.29:0/1032758693 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d80b0280 con 0x7ff6d80b43e0 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.554+0000 7ff6dfea4640 1 librados: init done 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.555+0000 7ff6dfea4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.555+0000 7ff6dfea4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.555+0000 7ff6dfea4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.555+0000 7ff6dfea4640 1 -- 172.21.15.29:0/1032758693 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d813ab30 con 0x7ff6d80b43e0 2024-04-09T12:05:31.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.575+0000 7ff6ce7fc640 1 -- 172.21.15.29:0/1032758693 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff6c80129d0 con 0x7ff6d80b43e0 2024-04-09T12:05:31.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.575+0000 7ff6ce7fc640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7ff6bc06c5e0 0x7ff6bc06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:05:31.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.575+0000 7ff6ddc40640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7ff6bc06c5e0 0x7ff6bc06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:05:31.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.575+0000 7ff6ddc40640 10 monclient: get_auth_request con 0x7ff6bc06c5e0 auth_method 0 2024-04-09T12:05:31.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.576+0000 7ff6ddc40640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7ff6bc06c5e0 0x7ff6bc06eaa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4036000 tx=0x7ff6d403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:05:31.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.576+0000 7ff6ce7fc640 10 client.4370.objecter ms_handle_connect 0x7ff6bc06c5e0 2024-04-09T12:05:31.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.577+0000 7ff6ce7fc640 1 -- 172.21.15.29:0/1032758693 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff6c80587c0 con 0x7ff6d80b43e0 2024-04-09T12:05:31.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.577+0000 7ff6ce7fc640 10 client.4370.objecter ms_dispatch 0x7ff6d8000b90 osd_map(25..25 src has 1..25) v4 2024-04-09T12:05:31.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.577+0000 7ff6ce7fc640 3 client.4370.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:05:31.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.577+0000 7ff6ce7fc640 3 client.4370.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:05:31.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.577+0000 7ff6ce7fc640 20 client.4370.objecter dump_active .. 0 homeless 2024-04-09T12:05:31.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.838+0000 7ff6ce7fc640 1 -- 172.21.15.29:0/1032758693 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181812 (secure 0 0 0) 0x7ff6c8054b00 con 0x7ff6d80b43e0 2024-04-09T12:05:31.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.838+0000 7ff6ce7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-09T12:05:31.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:31.838+0000 7ff6ce7fc640 10 monclient: _finish_command 1 = system:0 2024-04-09T12:05:32.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.066+0000 7ff6dfea4640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2024-04-09T12:05:32.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.066+0000 7ff6dfea4640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2024-04-09T12:05:32.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.066+0000 7ff6dfea4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-04-09T12:05:32.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.066+0000 7ff6dfea4640 1 -- 172.21.15.29:0/1032758693 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff6d804e160 con 0x7ff6d80b43e0 2024-04-09T12:05:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.074+0000 7ff6ce7fc640 1 -- 172.21.15.29:0/1032758693 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff6c8058120 con 0x7ff6d80b43e0 2024-04-09T12:05:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.075+0000 7ff6ce7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2024-04-09T12:05:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.075+0000 7ff6ce7fc640 10 monclient: _finish_command 2 = system:0 2024-04-09T12:05:32.078 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-09T12:05:32.078 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-09T12:05:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 10 librados: watch_flush enter 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 10 librados: watch_flush exit 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 20 client.4370.objecter shutdown clearing up homeless session... 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 10 client.4370.objecter successfully canceled tick 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 -- 172.21.15.29:0/1032758693 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7ff6bc06c5e0 msgr2=0x7ff6bc06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7ff6bc06c5e0 0x7ff6bc06eaa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4036000 tx=0x7ff6d403c040 comp rx=0 tx=0).stop 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 10 monclient: shutdown 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 -- 172.21.15.29:0/1032758693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 msgr2=0x7ff6d813a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 0x7ff6d813a220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800c480 tx=0x7ff6c800c940 comp rx=0 tx=0).stop 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 -- 172.21.15.29:0/1032758693 shutdown_connections 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7ff6bc06c5e0 0x7ff6bc06eaa0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6d813e420 0x7ff6d80afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6d80b43e0 0x7ff6d813a220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 --2- 172.21.15.29:0/1032758693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6d80b0d90 0x7ff6d8139ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:05:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 -- 172.21.15.29:0/1032758693 >> 172.21.15.29:0/1032758693 conn(0x7ff6d8065f30 msgr2=0x7ff6d813e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:05:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 -- 172.21.15.29:0/1032758693 shutdown_connections 2024-04-09T12:05:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 -- 172.21.15.29:0/1032758693 wait complete. 2024-04-09T12:05:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T12:05:32.077+0000 7ff6dfea4640 1 librados: shutdown 2024-04-09T12:05:32.091 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-09T12:05:32.092 INFO:teuthology.run_tasks:Running task workunit... 2024-04-09T12:05:32.105 INFO:tasks.workunit:Pulling workunits from ref d540ebaca6b131a1dd560e7f69e024b133bbaa42 2024-04-09T12:05:32.106 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-09T12:05:32.106 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-09T12:05:32.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-09T12:05:32.120 INFO:teuthology.orchestra.run.smithi029.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-09T12:05:32.121 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-09T12:05:32.175 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-09T12:05:32.175 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-09T12:05:32.230 INFO:tasks.workunit:timeout=6h 2024-04-09T12:05:32.230 INFO:tasks.workunit:cleanup=True 2024-04-09T12:05:32.230 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d540ebaca6b131a1dd560e7f69e024b133bbaa42 2024-04-09T12:05:32.285 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-09T12:05:36.258 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:01:29.887 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:36.264 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:01:29.893 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:36.306 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:01:29.935 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:36.313 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:29.942 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:36.313 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:01:29.942 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:36.319 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:01:29.948 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:36.320 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:29.949 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:36.365 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:29.994 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:36.369 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:01:29.997 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:56.415 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:01:50.043 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:56.464 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:50.092 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:56.466 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:01:50.094 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:56.466 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:50.095 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:56.480 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:50.109 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:56.490 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:01:50.119 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:56.529 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:01:50.157 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:56.530 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:01:50.159 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:05:56.544 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:01:50.173 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:21.490 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:02:15.118 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:21.539 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:02:15.168 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:21.557 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:02:15.186 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:21.587 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:15.215 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:21.588 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:15.217 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:21.598 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:02:15.226 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:21.600 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:02:15.228 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:21.604 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:15.233 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:21.619 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:02:15.248 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:26.904 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 96% (11680/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-04-09T12:06:27.823 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to 'd540ebaca6b131a1dd560e7f69e024b133bbaa42'. 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-04-09T12:06:27.824 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-09T12:06:27.825 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-04-09T12:06:27.825 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-09T12:06:27.825 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-09T12:06:27.825 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-09T12:06:27.825 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at d540ebaca6b Merge pull request #56672 from batrick/wip-65294-reef 2024-04-09T12:06:27.829 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-09T12:06:27.898 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-09T12:06:27.900 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-09T12:06:27.900 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-09T12:06:28.829 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-09T12:06:28.919 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-09T12:06:28.959 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-09T12:06:28.961 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-09T12:06:28.961 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-09T12:06:28.999 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-09T12:06:29.002 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-09T12:06:29.002 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-09T12:06:29.057 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-04-09T12:06:29.058 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-04-09T12:06:29.059 DEBUG:teuthology.orchestra.run.smithi029:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-04-09T12:06:29.117 INFO:tasks.workunit.client.0.smithi029.stderr:+ parallel=1 2024-04-09T12:06:29.117 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' '' = --serial ']' 2024-04-09T12:06:29.117 INFO:tasks.workunit.client.0.smithi029.stderr:+ color= 2024-04-09T12:06:29.118 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -t 1 ']' 2024-04-09T12:06:29.118 INFO:tasks.workunit.client.0.smithi029.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-04-09T12:06:29.118 INFO:tasks.workunit.client.0.smithi029.stderr:+ declare -A pids 2024-04-09T12:06:29.118 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.118 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.118 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_aio 2024-04-09T12:06:29.118 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_aio' 2024-04-09T12:06:29.118 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_aio 2024-04-09T12:06:29.118 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.119 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_aio 2024-04-09T12:06:29.119 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40650 2024-04-09T12:06:29.119 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_aio on pid 40650' 2024-04-09T12:06:29.119 INFO:tasks.workunit.client.0.smithi029.stdout:test api_aio on pid 40650 2024-04-09T12:06:29.122 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40650 2024-04-09T12:06:29.122 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.122 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_aio_pp 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_aio_pp' 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_aio_pp 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.123 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.125 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.125 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_aio_pp 2024-04-09T12:06:29.125 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40657 2024-04-09T12:06:29.125 INFO:tasks.workunit.client.0.smithi029.stdout:test api_aio_pp on pid 40657 2024-04-09T12:06:29.129 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_aio_pp on pid 40657' 2024-04-09T12:06:29.129 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40657 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_io 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_io' 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_io 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.130 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.132 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_io 2024-04-09T12:06:29.133 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40666 2024-04-09T12:06:29.134 INFO:tasks.workunit.client.0.smithi029.stdout:test api_io on pid 40666 2024-04-09T12:06:29.138 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_io on pid 40666' 2024-04-09T12:06:29.138 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40666 2024-04-09T12:06:29.138 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.138 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.138 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-04-09T12:06:29.138 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_io_pp 2024-04-09T12:06:29.138 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_io_pp' 2024-04-09T12:06:29.138 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_io_pp 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.139 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.140 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.142 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.143 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_io_pp 2024-04-09T12:06:29.143 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40677 2024-04-09T12:06:29.143 INFO:tasks.workunit.client.0.smithi029.stdout:test api_io_pp on pid 40677 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_io_pp on pid 40677' 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40677 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_asio 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_asio' 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_asio 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.149 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.151 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.152 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.153 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.154 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.155 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.155 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.155 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.155 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.155 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.155 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_asio 2024-04-09T12:06:29.155 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.155 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40693 2024-04-09T12:06:29.155 INFO:tasks.workunit.client.0.smithi029.stdout:test api_asio on pid 40693 2024-04-09T12:06:29.163 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_asio on pid 40693' 2024-04-09T12:06:29.163 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40693 2024-04-09T12:06:29.163 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.163 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.163 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-04-09T12:06:29.163 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_list 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_list' 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.164 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.165 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_list 2024-04-09T12:06:29.166 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.167 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.168 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.169 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40650/exe 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.170 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.171 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.171 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.171 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.171 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.171 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.171 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.171 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.171 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_list 2024-04-09T12:06:29.171 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40711 2024-04-09T12:06:29.171 INFO:tasks.workunit.client.0.smithi029.stdout:test api_list on pid 40711 2024-04-09T12:06:29.179 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_list on pid 40711' 2024-04-09T12:06:29.179 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40711 2024-04-09T12:06:29.179 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.179 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.179 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_lock 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_lock' 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.180 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_lock 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.181 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.182 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.183 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_aio 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_aio.log 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_aio: /' 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.184 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40657/exe 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.185 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.186 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.186 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.186 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.186 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.186 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.186 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.186 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.186 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.186 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.187 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.188 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.188 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.188 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.188 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.188 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.188 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_lock 2024-04-09T12:06:29.188 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40728 2024-04-09T12:06:29.188 INFO:tasks.workunit.client.0.smithi029.stdout:test api_lock on pid 40728 2024-04-09T12:06:29.196 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_lock on pid 40728' 2024-04-09T12:06:29.196 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40728 2024-04-09T12:06:29.196 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.196 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_lock_pp 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.197 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_lock_pp' 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_aio_pp: /' 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.198 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_lock_pp 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.199 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.200 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_aio_pp 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.201 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.202 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.203 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40666/exe 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_lock_pp 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40750 2024-04-09T12:06:29.205 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_lock_pp on pid 40750' 2024-04-09T12:06:29.206 INFO:tasks.workunit.client.0.smithi029.stdout:test api_lock_pp on pid 40750 2024-04-09T12:06:29.218 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40750 2024-04-09T12:06:29.218 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.218 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.218 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_misc 2024-04-09T12:06:29.218 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.218 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.218 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.218 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-04-09T12:06:29.218 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.218 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_misc' 2024-04-09T12:06:29.218 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.219 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.220 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.221 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40677/exe 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.222 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_io.log 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_io: /' 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.223 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.224 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_io 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.225 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.226 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_misc 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_io_pp 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_io_pp: /' 2024-04-09T12:06:29.227 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.228 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_misc 2024-04-09T12:06:29.229 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.229 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.229 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.229 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.229 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40774 2024-04-09T12:06:29.229 INFO:tasks.workunit.client.0.smithi029.stdout:test api_misc on pid 40774 2024-04-09T12:06:29.253 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_misc on pid 40774' 2024-04-09T12:06:29.253 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40774 2024-04-09T12:06:29.253 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.253 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.253 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.253 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-04-09T12:06:29.253 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.253 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.253 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_misc_pp 2024-04-09T12:06:29.253 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_misc_pp' 2024-04-09T12:06:29.253 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40693/exe 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.254 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.255 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.256 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.257 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_asio 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.258 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_asio: /' 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_asio.log 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.260 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.261 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.262 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40711/exe 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.263 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.264 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.265 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_list 2024-04-09T12:06:29.266 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40728/exe 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.267 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.268 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.269 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_lock.log 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_lock 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.270 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.271 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.272 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40774/exe 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_misc_pp 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_list: /' 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_misc_pp 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40819 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.273 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.274 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.274 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.274 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_misc_pp on pid 40819' 2024-04-09T12:06:29.274 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.274 INFO:tasks.workunit.client.0.smithi029.stdout:test api_misc_pp on pid 40819 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40819 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_tier_pp 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_misc 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_tier_pp' 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_list.log 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_tier_pp 2024-04-09T12:06:29.281 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.282 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_misc: /' 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_lock: /' 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_misc.log 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.283 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.284 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_tier_pp 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40854 2024-04-09T12:06:29.285 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_tier_pp on pid 40854' 2024-04-09T12:06:29.286 INFO:tasks.workunit.client.0.smithi029.stdout:test api_tier_pp on pid 40854 2024-04-09T12:06:29.290 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40854 2024-04-09T12:06:29.290 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.290 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.290 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-04-09T12:06:29.290 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_pool 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_pool' 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_pool 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.291 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_pool 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.293 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.294 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.294 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.294 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.294 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40880 2024-04-09T12:06:29.294 INFO:tasks.workunit.client.0.smithi029.stdout:test api_pool on pid 40880 2024-04-09T12:06:29.305 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_pool on pid 40880' 2024-04-09T12:06:29.305 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40880 2024-04-09T12:06:29.305 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.305 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.305 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.305 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40750/exe 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.306 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.307 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.308 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_snapshots 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_snapshots' 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_lock_pp 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.309 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.310 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.311 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_snapshots 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.312 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_lock_pp: /' 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.313 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.314 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.315 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.315 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.315 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.315 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_snapshots 2024-04-09T12:06:29.315 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40909 2024-04-09T12:06:29.315 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_snapshots on pid 40909' 2024-04-09T12:06:29.315 INFO:tasks.workunit.client.0.smithi029.stdout:test api_snapshots on pid 40909 2024-04-09T12:06:29.320 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40909 2024-04-09T12:06:29.320 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.320 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_snapshots_pp 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_snapshots_pp' 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.321 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.322 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_snapshots_pp 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_snapshots_pp 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40936 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.324 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.325 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.325 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.325 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_snapshots_pp on pid 40936' 2024-04-09T12:06:29.325 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.325 INFO:tasks.workunit.client.0.smithi029.stdout:test api_snapshots_pp on pid 40936 2024-04-09T12:06:29.332 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40936 2024-04-09T12:06:29.332 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.332 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.332 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.332 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.332 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.332 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.332 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.333 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_stat 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.334 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_stat' 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.335 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.336 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.337 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_stat 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.338 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.339 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40819/exe 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.340 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.341 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.341 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.341 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.341 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-04-09T12:06:29.341 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [----------] Global test environment set-up. 2024-04-09T12:06:29.341 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [----------] 12 tests from AsioRados 2024-04-09T12:06:29.341 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.223+0000 7fb833f78780 10 monclient: get_monmap_and_config 2024-04-09T12:06:29.341 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.223+0000 7fb833f78780 10 monclient: build_initial_monmap 2024-04-09T12:06:29.341 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.223+0000 7fb833f78780 10 monclient: monmap: 2024-04-09T12:06:29.341 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: epoch 0 2024-04-09T12:06:29.341 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: last_changed 0.000000 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: created 0.000000 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: min_mon_release 0 (unknown) 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: election_strategy: 1 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.223+0000 7fb833f78780 1 Processor -- start 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.223+0000 7fb833f78780 1 -- start start 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.223+0000 7fb833f78780 10 monclient: init 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 10 monclient: _reopen_session rank -1 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 10 monclient: _add_conns ranks=[2,1,0] 2024-04-09T12:06:29.342 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a93ec55490 0x55a93ec542f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 10 monclient(hunting): picked mon.noname-c con 0x55a93ec55490 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a93ec584f0 0x55a93ec58e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 10 monclient(hunting): picked mon.noname-b con 0x55a93ec584f0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ece8450 0x55a93ec59340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 10 monclient(hunting): picked mon.noname-a con 0x55a93ece8450 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 10 monclient(hunting): start opening mon connection 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93eb6ab20 con 0x55a93ece8450 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 10 monclient(hunting): start opening mon connection 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93eb6a7c0 con 0x55a93ec584f0 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 10 monclient(hunting): start opening mon connection 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a93eb4d4e0 con 0x55a93ec55490 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 10 monclient(hunting): _renew_subs 2024-04-09T12:06:29.343 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.224+0000 7fb833f78780 10 monclient(hunting): authenticate will time out at 1455.344741s 2024-04-09T12:06:29.345 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.345 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.345 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.346 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.347 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.347 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.347 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.347 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.347 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_stat 2024-04-09T12:06:29.347 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.347 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.347 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40969 2024-04-09T12:06:29.347 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: test api_stat on pid 40969 2024-04-09T12:06:29.355 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_stat on pid 40969' 2024-04-09T12:06:29.355 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=40969 2024-04-09T12:06:29.355 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.355 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.355 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.355 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.355 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.355 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.355 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_stat_pp 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.356 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.357 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.357 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.357 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.357 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.357 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.357 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_stat_pp' 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40880/exe 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.358 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.359 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_stat_pp 2024-04-09T12:06:29.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.359 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.359 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-04-09T12:06:29.359 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.359 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.359 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.359 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_misc_pp 2024-04-09T12:06:29.359 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.360 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.360 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.360 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.360 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.360 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.360 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.360 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.360 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.360 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.360 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.361 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_pool 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.362 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.363 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.363 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.363 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.363 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.363 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.363 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_misc_pp: /' 2024-04-09T12:06:29.363 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-04-09T12:06:29.363 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_pool.log 2024-04-09T12:06:29.363 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_stat_pp 2024-04-09T12:06:29.363 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41000 2024-04-09T12:06:29.363 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_stat_pp on pid 41000' 2024-04-09T12:06:29.364 INFO:tasks.workunit.client.0.smithi029.stdout:test api_stat_pp on pid 41000 2024-04-09T12:06:29.370 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41000 2024-04-09T12:06:29.370 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.370 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.370 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_pool: /' 2024-04-09T12:06:29.370 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.370 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.370 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.371 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_watch_notify 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_watch_notify' 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_watch_notify 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.372 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.373 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.373 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.373 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.373 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.373 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.373 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.373 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.373 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.373 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.373 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.373 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_watch_notify 2024-04-09T12:06:29.374 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41009 2024-04-09T12:06:29.375 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_watch_notify on pid 41009' 2024-04-09T12:06:29.375 INFO:tasks.workunit.client.0.smithi029.stdout:test api_watch_notify on pid 41009 2024-04-09T12:06:29.390 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41009 2024-04-09T12:06:29.390 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.390 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40854/exe 2024-04-09T12:06:29.390 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.391 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.392 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.393 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.394 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.394 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.394 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.394 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.394 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.394 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.394 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.394 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_watch_notify_pp 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.395 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_watch_notify_pp' 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.396 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_watch_notify_pp 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.397 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_tier_pp 2024-04-09T12:06:29.398 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.398 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.398 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.398 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.398 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.398 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.398 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.398 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.398 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-04-09T12:06:29.398 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.398 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.399 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.399 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.399 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.399 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.399 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.399 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.399 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.399 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.399 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.399 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.399 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.400 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.400 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.400 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.400 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.400 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.400 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.400 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.400 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.400 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.401 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_tier_pp: /' 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.402 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.403 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.403 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40909/exe 2024-04-09T12:06:29.403 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.403 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_watch_notify_pp 2024-04-09T12:06:29.403 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.403 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.403 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41053 2024-04-09T12:06:29.403 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_watch_notify_pp on pid 41053' 2024-04-09T12:06:29.404 INFO:tasks.workunit.client.0.smithi029.stdout:test api_watch_notify_pp on pid 41053 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41053 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.420 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_cmd 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.421 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_cmd' 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.422 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.423 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.423 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_snapshots 2024-04-09T12:06:29.423 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.423 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.423 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.423 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.423 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.423 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.423 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.423 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.423 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.424 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.425 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_snapshots: /' 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.426 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_cmd 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40936/exe 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.427 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.428 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.428 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.428 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.428 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.428 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.428 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.428 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.428 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_cmd 2024-04-09T12:06:29.428 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41078 2024-04-09T12:06:29.428 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_cmd on pid 41078' 2024-04-09T12:06:29.429 INFO:tasks.workunit.client.0.smithi029.stdout:test api_cmd on pid 41078 2024-04-09T12:06:29.436 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41078 2024-04-09T12:06:29.436 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.436 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.436 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.436 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.436 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.436 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.436 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.436 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.436 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_snapshots_pp 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.437 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_cmd_pp 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.438 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_cmd_pp' 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_cmd_pp 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.439 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.440 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.441 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.441 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.441 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.441 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.441 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.441 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.441 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.441 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.441 INFO:tasks.workunit.client.0.smithi029.stdout:2024-04-09T12:06:29.226+0000 7fb83204a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ece8450 0x55a93ec59340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:06:29.441 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.227+0000 7fb83204a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ece8450 0x55a93ec59340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34094/0 (socket says 172.21.15.29:34094) 2024-04-09T12:06:29.441 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.227+0000 7fb83204a640 1 -- 172.21.15.29:0/2436570472 learned_addr learned my addr 172.21.15.29:0/2436570472 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:06:29.442 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.227+0000 7fb83204a640 10 monclient(hunting): get_auth_request con 0x55a93ece8450 auth_method 0 2024-04-09T12:06:29.442 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.227+0000 7fb83204a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:06:29.442 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.227+0000 7fb83204a640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:06:29.442 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.227+0000 7fb83204a640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:06:29.442 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.227+0000 7fb83204a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:06:29.442 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.227+0000 7fb83204a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:06:29.442 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.227+0000 7fb83204a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:06:29.442 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.230+0000 7fb83204a640 10 monclient(hunting): handle_auth_done global_id 4404 payload 274 2024-04-09T12:06:29.442 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.230+0000 7fb83204a640 1 -- 172.21.15.29:0/2436570472 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a93ec55490 msgr2=0x55a93ec542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:06:29.442 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.230+0000 7fb83204a640 1 --2- 172.21.15.29:0/2436570472 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a93ec55490 0x55a93ec542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:06:29.442 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.230+0000 7fb83204a640 1 -- 172.21.15.29:0/2436570472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a93ec584f0 msgr2=0x55a93ec58e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.230+0000 7fb83204a640 1 --2- 172.21.15.29:0/2436570472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a93ec584f0 0x55a93ec58e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.230+0000 7fb83204a640 10 monclient: _finish_hunting 0 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.230+0000 7fb83204a640 1 monclient: found mon.noname-a 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.230+0000 7fb83204a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.230+0000 7fb83204a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.230+0000 7fb83204a640 1 -- 172.21.15.29:0/2436570472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb824005b10 con 0x55a93ece8450 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.235+0000 7fb83204a640 1 --2- 172.21.15.29:0/2436570472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ece8450 0x55a93ec59340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb82800a3f0 tx=0x7fb82800a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2e5da2a952e04c server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 1 -- 172.21.15.29:0/2436570472 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800b930 con 0x55a93ece8450 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 10 monclient: dump: 2024-04-09T12:06:29.443 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: epoch 1 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: min_mon_release 18 (reef) 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: election_strategy: 1 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 10 monclient: _finish_auth 0 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 10 monclient: _check_auth_tickets 2024-04-09T12:06:29.444 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 1 -- 172.21.15.29:0/2436570472 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82800ba90 con 0x55a93ece8450 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 1 -- 172.21.15.29:0/2436570472 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800be20 con 0x55a93ece8450 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.277+0000 7fb823fff640 10 monclient: dump: 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: epoch 1 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: min_mon_release 18 (reef) 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: election_strategy: 1 2024-04-09T12:06:29.445 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:06:29.446 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:06:29.446 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:06:29.446 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.446 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.278+0000 7fb833f78780 5 monclient: authenticate success, global_id 4404 2024-04-09T12:06:29.446 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.278+0000 7fb833f78780 10 monclient: get_monmap_and_config success 2024-04-09T12:06:29.446 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.278+0000 7fb833f78780 4 set_mon_vals no callback set 2024-04-09T12:06:29.446 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.278+0000 7fb833f78780 10 monclient: shutdown 2024-04-09T12:06:29.446 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.278+0000 7fb833f78780 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:06:29.446 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.278+0000 7fb833f78780 1 -- 172.21.15.29:0/2436570472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ece8450 msgr2=0x55a93ec59340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:06:29.446 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.278+0000 7fb833f78780 1 --2- 172.21.15.29:0/2436570472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ece8450 0x55a93ec59340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb82800a3f0 tx=0x7fb82800a8b0 comp rx=0 tx=0).stop 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.448 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.449 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.279+0000 7fb833f78780 1 -- 172.21.15.29:0/2436570472 shutdown_connections 2024-04-09T12:06:29.449 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.279+0000 7fb833f78780 1 --2- 172.21.15.29:0/2436570472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ece8450 0x55a93ec59340 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:06:29.449 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.279+0000 7fb833f78780 1 --2- 172.21.15.29:0/2436570472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a93ec584f0 0x55a93ec58e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:06:29.449 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.279+0000 7fb833f78780 1 --2- 172.21.15.29:0/2436570472 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a93ec55490 0x55a93ec542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:06:29.449 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.279+0000 7fb833f78780 1 -- 172.21.15.29:0/2436570472 >> 172.21.15.29:0/2436570472 conn(0x55a93ec15530 msgr2=0x55a93ece4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:06:29.449 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.279+0000 7fb833f78780 1 -- 172.21.15.29:0/2436570472 shutdown_connections 2024-04-09T12:06:29.449 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.279+0000 7fb833f78780 1 -- 172.21.15.29:0/2436570472 wait complete. 2024-04-09T12:06:29.449 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.279+0000 7fb833f78780 10 monclient: build_initial_monmap 2024-04-09T12:06:29.449 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.279+0000 7fb833f78780 10 monclient: monmap: 2024-04-09T12:06:29.449 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: epoch 0 2024-04-09T12:06:29.449 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: last_changed 0.000000 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: created 0.000000 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: min_mon_release 0 (unknown) 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: election_strategy: 1 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.279+0000 7fb833f78780 1 librados: starting msgr at 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.279+0000 7fb833f78780 1 librados: starting objecter 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.280+0000 7fb833f78780 1 Processor -- start 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.280+0000 7fb833f78780 1 -- start start 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.280+0000 7fb833f78780 1 librados: setting wanted keys 2024-04-09T12:06:29.450 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.280+0000 7fb833f78780 1 librados: calling monclient init 2024-04-09T12:06:29.451 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.280+0000 7fb833f78780 10 monclient: init 2024-04-09T12:06:29.451 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 10 monclient: _reopen_session rank -1 2024-04-09T12:06:29.451 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 10 monclient: _add_conns ranks=[0,1,2] 2024-04-09T12:06:29.451 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ec55490 0x55a93ece6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:06:29.451 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 10 monclient(hunting): picked mon.noname-a con 0x55a93ec55490 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-04-09T12:06:29.451 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a93ec584f0 0x55a93ece9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:06:29.451 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 10 monclient(hunting): picked mon.noname-b con 0x55a93ec584f0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-04-09T12:06:29.453 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.453 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.453 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.454 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.455 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.455 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.455 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.455 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.455 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.455 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.455 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.455 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.455 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_cmd_pp 2024-04-09T12:06:29.455 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41124 2024-04-09T12:06:29.456 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a93ece8450 0x55a93ece9940 unknown :-1 s=NONE pgs=0 ctest api_cmd_pp on pid 41124 2024-04-09T12:06:29.467 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_cmd_pp on pid 41124' 2024-04-09T12:06:29.467 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41124 2024-04-09T12:06:29.467 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.467 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.467 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_service 2024-04-09T12:06:29.467 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_service' 2024-04-09T12:06:29.467 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.467 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.467 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-04-09T12:06:29.467 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.468 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.469 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.469 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.469 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.469 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.469 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.469 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.469 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.469 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.469 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.469 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.469 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/40969/exe 2024-04-09T12:06:29.470 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_service 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.471 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.472 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.473 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.473 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.473 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.473 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.473 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.473 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.473 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.473 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.473 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.473 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.473 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_stat: /' 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.474 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_service 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41148 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_service on pid 41148' 2024-04-09T12:06:29.476 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.477 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.477 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.477 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.477 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.477 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.477 INFO:tasks.workunit.client.0.smithi029.stdout:test api_service on pid 41148 2024-04-09T12:06:29.486 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.486 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.486 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.486 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.486 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.486 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.486 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.486 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41148 2024-04-09T12:06:29.486 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.486 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.487 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_stat 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.488 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_stat.log 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.489 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.490 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.491 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_service_pp 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.492 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stdout:s=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 10 monclient(hunting): picked mon.noname-c con 0x55a93ece8450 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 10 monclient(hunting): start opening mon connection 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93ecea9b0 con 0x55a93ec55490 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 10 monclient(hunting): start opening mon connection 2024-04-09T12:06:29.493 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93ece9e80 con 0x55a93ec584f0 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 10 monclient(hunting): start opening mon connection 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a93ec1b340 con 0x55a93ece8450 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 10 monclient(hunting): _renew_subs 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.281+0000 7fb833f78780 10 monclient(hunting): authenticate will time out at 1455.401103s 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.300+0000 7fb831849640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ec55490 0x55a93ece6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.300+0000 7fb831048640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a93ec584f0 0x55a93ece9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.302+0000 7fb831849640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ec55490 0x55a93ece6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34146/0 (socket says 172.21.15.29:34146) 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.302+0000 7fb831849640 1 -- 172.21.15.29:0/2748023636 learned_addr learned my addr 172.21.15.29:0/2748023636 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.302+0000 7fb831849640 10 monclient(hunting): get_auth_request con 0x55a93ec55490 auth_method 0 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.302+0000 7fb831849640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.303+0000 7fb831849640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.303+0000 7fb831849640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:06:29.494 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.303+0000 7fb831849640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-09T12:06:29.495 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.303+0000 7fb831849640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:06:29.495 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.303+0000 7fb831849640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:06:29.495 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.304+0000 7fb831048640 10 monclient(hunting): get_auth_request con 0x55a93ec584f0 auth_method 0 2024-04-09T12:06:29.495 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.304+0000 7fb831048640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-09T12:06:29.495 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.304+0000 7fb831048640 10 monclient(hunting): _init_auth method 2 2024-04-09T12:06:29.495 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.304+0000 7fb831048640 10 monclient(hunting): _init_auth creating new auth 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.511 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_service_pp' 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.514 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.515 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.516 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.517 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_service_pp 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.518 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41000/exe 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.519 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.520 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41124/exe 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.521 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.522 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_stat_pp: /' 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.523 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.524 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_stat_pp 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_cmd_pp 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41053/exe 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_service_pp 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41222 2024-04-09T12:06:29.525 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_service_pp on pid 41222' 2024-04-09T12:06:29.526 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831048640 10 monclient(hunting): handtest api_service_pp on pid 41222 2024-04-09T12:06:29.532 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41222 2024-04-09T12:06:29.532 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.533 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.534 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.535 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_c_write_operations 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_c_write_operations' 2024-04-09T12:06:29.536 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_c_write_operations 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.537 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_c_write_operations 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41240 2024-04-09T12:06:29.538 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_c_write_operations on pid 41240' 2024-04-09T12:06:29.539 INFO:tasks.workunit.client.0.smithi029.stdout:test api_c_write_operations on pid 41240 2024-04-09T12:06:29.547 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41009/exe 2024-04-09T12:06:29.547 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41240 2024-04-09T12:06:29.547 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_c_read_operations 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_c_read_operations' 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_c_read_operations 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.548 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.549 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.550 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_watch_notify 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41078/exe 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.551 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.552 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_watch_notify: /' 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.553 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.554 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.554 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.554 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.554 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.554 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.554 INFO:tasks.workunit.client.0.smithi029.stdout:le_auth_reply_more payload 9 2024-04-09T12:06:29.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831048640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-09T12:06:29.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831048640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-09T12:06:29.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831849640 10 monclient(hunting): handle_auth_done global_id 4422 payload 824 2024-04-09T12:06:29.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831849640 1 -- 172.21.15.29:0/2748023636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a93ece8450 msgr2=0x55a93ece9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831849640 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a93ece8450 0x55a93ece9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831849640 1 -- 172.21.15.29:0/2748023636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a93ec584f0 msgr2=0x55a93ece9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831849640 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a93ec584f0 0x55a93ece9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831849640 10 monclient: _finish_hunting 0 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831849640 1 monclient: found mon.noname-a 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831849640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831849640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.307+0000 7fb831849640 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828005c50 con 0x55a93ec55490 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.317+0000 7fb831849640 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ec55490 0x55a93ece6c30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb82c008060 tx=0x7fb82c008520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.317+0000 7fb822ffd640 10 client.?.objecter ms_handle_connect 0x55a93ec55490 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.317+0000 7fb822ffd640 10 client.?.objecter resend_mon_ops 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c010640 con 0x55a93ec55490 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-09T12:06:29.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 10 monclient: dump: 2024-04-09T12:06:29.556 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: epoch 1 2024-04-09T12:06:29.556 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:06:29.556 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:06:29.556 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:06:29.556 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: min_mon_release 18 (reef) 2024-04-09T12:06:29.556 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: election_strategy: 1 2024-04-09T12:06:29.556 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:06:29.556 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:06:29.556 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:06:29.556 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.556 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 10 monclient: _finish_auth 0 2024-04-09T12:06:29.559 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.559 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.559 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.559 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_cmd 2024-04-09T12:06:29.559 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_cmd.log 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_cmd: /' 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_c_read_operations 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.560 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.561 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41268 2024-04-09T12:06:29.562 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_c_read_operations on pid 41268' 2024-04-09T12:06:29.562 INFO:tasks.workunit.client.0.smithi029.stdout: test api_c_read_operations on pid 41268 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41268 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.569 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.571 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s api_cls_remote_reads 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' api_cls_remote_reads' 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo api_cls_remote_reads 2024-04-09T12:06:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=api_cls_remote_reads 2024-04-09T12:06:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41292 2024-04-09T12:06:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test api_cls_remote_reads on pid 41292' 2024-04-09T12:06:29.575 INFO:tasks.workunit.client.0.smithi029.stdout:test api_cls_remote_reads on pid 41292 2024-04-09T12:06:29.585 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41292 2024-04-09T12:06:29.585 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.585 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.585 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41148/exe 2024-04-09T12:06:29.585 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s list_parallel 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' list_parallel' 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_service.log 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_service: /' 2024-04-09T12:06:29.586 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_service 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.587 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.588 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.589 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.590 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo list_parallel 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.591 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.592 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.593 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.594 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.594 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.594 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=list_parallel 2024-04-09T12:06:29.594 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41344 2024-04-09T12:06:29.594 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test list_parallel on pid 41344' 2024-04-09T12:06:29.594 INFO:tasks.workunit.client.0.smithi029.stdout:test list_parallel on pid 41344 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41344 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.609 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s open_pools_parallel 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' open_pools_parallel' 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.610 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.611 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.611 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.611 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.611 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.611 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.611 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.611 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.611 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.611 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.611 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.613 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.613 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.613 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.613 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.614 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.616 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.617 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.618 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41222/exe 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo open_pools_parallel 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.620 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.621 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_service_pp 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-04-09T12:06:29.622 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.623 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.623 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.623 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=open_pools_parallel 2024-04-09T12:06:29.623 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.623 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.623 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41395 2024-04-09T12:06:29.623 INFO:tasks.workunit.client.0.smithi029.stdout:test open_pools_parallel on pid 41395 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test open_pools_parallel on pid 41395' 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41395 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.633 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.634 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.635 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:++ printf %25s delete_pools_parallel 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:+ r=' delete_pools_parallel' 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_service_pp: /' 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41268/exe 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41240/exe 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo delete_pools_parallel 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.636 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.637 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.638 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.639 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_c_read_operations 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+ ff=delete_pools_parallel 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-04-09T12:06:29.640 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=41428 2024-04-09T12:06:29.641 INFO:tasks.workunit.client.0.smithi029.stdout:test delete_pools_parallel on pid 41428 2024-04-09T12:06:29.648 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'test delete_pools_parallel on pid 41428' 2024-04-09T12:06:29.648 INFO:tasks.workunit.client.0.smithi029.stderr:+ pids[$f]=41428 2024-04-09T12:06:29.648 INFO:tasks.workunit.client.0.smithi029.stderr:+ ret=0 2024-04-09T12:06:29.648 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -eq 1 ']' 2024-04-09T12:06:29.648 INFO:tasks.workunit.client.0.smithi029.stderr:+ for t in "${!pids[@]}" 2024-04-09T12:06:29.648 INFO:tasks.workunit.client.0.smithi029.stderr:+ pid=40854 2024-04-09T12:06:29.648 INFO:tasks.workunit.client.0.smithi029.stderr:+ wait 40854 2024-04-09T12:06:29.648 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_c_write_operations 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -f /etc/bashrc ']' 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:+ . /etc/bashrc 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:++ BASHRCSOURCED=Y 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:++ shopt -q login_shell 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:+++ umask 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' 0022 -eq 0 ']' 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:++ SHELL=/bin/bash 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.649 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-09T12:06:29.650 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.651 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.652 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.653 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.654 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.655 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.655 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.655 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.655 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.655 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.655 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 10 monclient: _check_auth_tickets 2024-04-09T12:06:29.655 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:29.655 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c0107c0 con 0x55a93ec55490 2024-04-09T12:06:29.655 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 10 monclient: handle_config config(0 keys) v1 2024-04-09T12:06:29.655 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c010bb0 con 0x55a93ec55490 2024-04-09T12:06:29.655 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb822ffd640 10 monclient: dump: 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: epoch 1 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: last_changed 2024-04-09T12:03:35.308336+0000 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: created 2024-04-09T12:03:35.308336+0000 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: min_mon_release 18 (reef) 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: election_strategy: 1 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.656 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb833f78780 5 monclient: authenticate success, global_id 4422 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb833f78780 10 monclient: _renew_subs 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb833f78780 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a93eb79be0 con 0x55a93ec55490 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb833f78780 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb833f78780 10 monclient: _renew_subs 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb833f78780 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a93eb6d020 con 0x55a93ec55490 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb833f78780 1 librados: init done 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb833f78780 10 librados: wait_for_osdmap waiting 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.350+0000 7fb8237fe640 4 set_mon_vals no callback set 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.430+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb82c010d10 con 0x55a93ec55490 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.431+0000 7fb822ffd640 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fb81406a800 0x7fb81406ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:06:29.657 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.431+0000 7fb831048640 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fb81406a800 0x7fb81406ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:06:29.675 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.675 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.675 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.675 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.675 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.675 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41292/exe 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.676 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_api_cls_remote_reads 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'grep=grep --color=auto' 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.677 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorls.sh 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' '!' -t 0 ']' 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:+++ return 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export S_COLORS=auto 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:+++ S_COLORS=auto 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.679 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-09T12:06:29.680 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41344/exe 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.681 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.682 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_list_parallel.log 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-09T12:06:29.683 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/gawk.sh 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/lang.sh 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_list_parallel 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/locale 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ list_parallel: /' 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.684 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.685 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:++++ export LANG=en_US.UTF-8 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:++++ LANG=en_US.UTF-8 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.686 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:+++ LANG=en_US.UTF-8 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:+++ unset LANG_backup config 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n '' ']' 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' dumb = linux ']' 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.687 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/less.sh 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:++ for i in /etc/profile.d/*.sh 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '' ']' 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:++ . /etc/profile.d/which2.sh 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41428/exe 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:+++++ readlink /proc/41395/exe 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:++++ basename /usr/bin/bash 2024-04-09T12:06:29.688 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_declare='declare -f' 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:+++ which_opt=-f 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export which_declare 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:+++ export -f which 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset i 2024-04-09T12:06:29.689 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset -f pathmunge 2024-04-09T12:06:29.690 INFO:tasks.workunit.client.0.smithi029.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-09T12:06:29.690 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_delete_pools_parallel 2024-04-09T12:06:29.690 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-04-09T12:06:29.690 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-09T12:06:29.690 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset rc 2024-04-09T12:06:29.690 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-04-09T12:06:29.690 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-04-09T12:06:29.690 INFO:tasks.workunit.client.0.smithi029.stderr:+ ceph_test_rados_open_pools_parallel 2024-04-09T12:06:29.690 INFO:tasks.workunit.client.0.smithi029.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-04-09T12:06:29.690 INFO:tasks.workunit.client.0.smithi029.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-04-09T12:06:31.948 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.431+0000 7fb831048640 10 monclient: get_auth_request con 0x7fb81406a800 auth_method 0 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.435+0000 7fb831048640 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fb81406a800 0x7fb81406ccc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb82405a000 tx=0x7fb82400e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.435+0000 7fb822ffd640 10 client.4422.objecter ms_handle_connect 0x7fb81406a800 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.460+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb82c0576a0 con 0x55a93ec55490 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.460+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(25..25 src has 1..25) v4 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.460+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [25,25] > 0 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.460+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding full epoch 25 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.460+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.460+0000 7fb833f78780 10 librados: wait_for_osdmap done waiting 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.460+0000 7fb833f78780 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.460+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8240587c0 con 0x55a93ec55490 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.614+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb82c0532e0 con 0x55a93ec55490 2024-04-09T12:06:31.949 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.614+0000 7fb822ffd640 10 monclient: handle_get_version_reply finishing 1 version 25 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.614+0000 7fb823fff640 10 client.4422.objecter _get_latest_version latest 25, have it 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.614+0000 7fb833f78780 10 client.4422.objecter create_pool name=ceph_test_rados_api_asio 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.614+0000 7fb833f78780 10 client.4422.objecter pool_op_submit 1 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.614+0000 7fb833f78780 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:29.614+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x55a93ebd8ed0 con 0x55a93ec55490 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:31.946+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v27) v1 ==== 43+0+0 (secure 0 0 0) 0x7fb82c056d70 con 0x55a93ec55490 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:31.946+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 pool_op_reply(tid 1 (0) Success v27) v1 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:31.946+0000 7fb822ffd640 10 client.4422.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v27) v1 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:31.946+0000 7fb822ffd640 10 client.4422.objecter have request 1 at 0x55a93eceb570 Op: create 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:31.946+0000 7fb822ffd640 20 client.4422.objecter waiting for client to reach epoch 27 before calling back 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:31.946+0000 7fb822ffd640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:06:31.950 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:31.946+0000 7fb822ffd640 10 monclient: _renew_subs 2024-04-09T12:06:32.283 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:31.946+0000 7fb822ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:06:32.283 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:31.946+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=26}) v3 -- 0x7fb814070540 con 0x55a93ec55490 2024-04-09T12:06:32.283 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:31.946+0000 7fb822ffd640 10 client.4422.objecter done 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.243+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 8 ==== osd_map(26..27 src has 1..27) v4 ==== 10143+0+0 (secure 0 0 0) 0x7fb82c056fa0 con 0x55a93ec55490 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.243+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(26..27 src has 1..27) v4 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.243+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [26,27] > 25 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.243+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 26 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.243+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 27 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.243+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.243+0000 7fb833f78780 10 librados: set snap read head -> 1 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.243+0000 7fb833f78780 10 librados: writefull oid=exist nspace= 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed814e0 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 27 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:06:32.284 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] conn(0x55a93ec1add0 0x55a93ed81ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T12:06:32.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:06:32.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [writefull 0~5 in=5b] tid 2 osd.2 2024-04-09T12:06:32.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:06:32.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 2 2024-04-09T12:06:32.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 15 client.4422.objecter _send_op 2 to 4.1 on osd.2 2024-04-09T12:06:32.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:2 4.1 4:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a93ed88750 con 0x55a93ec1add0 2024-04-09T12:06:32.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:06:32.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.244+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:06:32.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.281+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:32.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.281+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:32.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.281+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:42.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.281+0000 7fb821ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:06:42.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.317+0000 7fb83204a640 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] conn(0x55a93ec1add0 0x55a93ed81ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-09T12:06:42.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.323+0000 7fb83204a640 10 monclient: get_auth_request con 0x55a93ec1add0 auth_method 0 2024-04-09T12:06:42.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.332+0000 7fb822ffd640 10 client.4422.objecter ms_handle_connect 0x55a93ec1add0 2024-04-09T12:06:42.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:32.332+0000 7fb83204a640 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] conn(0x55a93ec1add0 0x55a93ed81ee0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-09T12:06:42.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:33.281+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:42.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:33.281+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:42.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:33.281+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:42.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:34.281+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:42.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:34.281+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:42.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:34.281+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:42.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:34.351+0000 7fb833aad640 10 client.4422.objecter tick 2024-04-09T12:06:42.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:35.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:42.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:35.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:42.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:35.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:42.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:36.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:42.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:36.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:42.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:36.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:42.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:37.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:42.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:37.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:42.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:37.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:42.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:38.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:42.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:38.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:42.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:38.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:42.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:39.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:42.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:39.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:42.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:39.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:42.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:39.352+0000 7fb833aad640 10 client.4422.objecter tick 2024-04-09T12:06:42.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:40.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:42.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:40.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:42.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:40.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:42.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:41.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:42.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:41.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:42.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:41.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:42.317 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:02:35.946 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:42.396 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:02:36.024 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:42.413 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:36.042 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:42.417 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:36.046 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:42.446 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:02:36.074 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:42.511 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:02:36.140 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:42.536 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:02:36.165 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:42.569 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:36.198 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:42.646 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:02:36.275 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:06:44.517 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:42.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:44.517 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:42.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:44.517 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:42.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:44.517 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:42.282+0000 7fb821ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:06:44.517 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:43.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:44.517 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:43.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:44.517 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:43.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:44.517 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:44.517 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:44.517 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.353+0000 7fb833aad640 10 client.4422.objecter tick 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.353+0000 7fb833aad640 2 client.4422.objecter tid 2 on osd.2 is laggy 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.353+0000 7fb833aad640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.353+0000 7fb833aad640 10 monclient: _renew_subs 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.353+0000 7fb833aad640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.353+0000 7fb833aad640 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=28}) v3 -- 0x7fb804002f90 con 0x55a93ec55490 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.353+0000 7fb833aad640 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- ping magic: 0 v1 -- 0x7fb804003320 con 0x55a93ec1add0 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 9 ==== osd_map(28..36 src has 1..36) v4 ==== 15413+0+0 (secure 0 0 0) 0x7fb82c05add0 con 0x55a93ec55490 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(28..36 src has 1..36) v4 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [28,36] > 27 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 28 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:44.518 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 28 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:44.519 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:44.519 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 29 2024-04-09T12:06:44.519 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:44.519 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 29 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:44.519 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:44.519 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 30 2024-04-09T12:06:44.519 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:46.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 30 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:46.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:46.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 31 2024-04-09T12:06:46.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:46.285 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 31 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 32 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 32 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 33 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 33 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 34 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:46.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 34 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 35 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 35 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 36 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 36 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:44.514+0000 7fb822ffd640 20 client.4422.objecter 2 4.d3a59201 osd.2 exist [writefull 0~5 in=5b] 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:45.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:45.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:46.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:45.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:49.414 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:46.282+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:49.414 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:46.282+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:49.414 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:46.282+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:49.414 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:47.283+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:49.414 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:47.283+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:49.414 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:47.283+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:49.415 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:48.283+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:49.415 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:48.283+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:49.415 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:48.283+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:49.415 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.284+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:49.415 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.284+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:49.415 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.284+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:49.415 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.354+0000 7fb833aad640 10 client.4422.objecter tick 2024-04-09T12:06:49.416 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.354+0000 7fb833aad640 2 client.4422.objecter tid 2 on osd.2 is laggy 2024-04-09T12:06:49.416 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.354+0000 7fb833aad640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:06:49.416 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.354+0000 7fb833aad640 10 monclient: _renew_subs 2024-04-09T12:06:49.416 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.354+0000 7fb833aad640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:06:49.416 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.354+0000 7fb833aad640 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=37}) v3 -- 0x7fb8040034e0 con 0x55a93ec55490 2024-04-09T12:06:49.416 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.354+0000 7fb833aad640 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- ping magic: 0 v1 -- 0x7fb804003720 con 0x55a93ec1add0 2024-04-09T12:06:49.416 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 10 ==== osd_map(37..40 src has 1..40) v4 ==== 3285+0+0 (secure 0 0 0) 0x7fb82c0550e0 con 0x55a93ec55490 2024-04-09T12:06:49.416 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(37..40 src has 1..40) v4 2024-04-09T12:06:49.417 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [37,40] > 36 2024-04-09T12:06:49.417 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 37 2024-04-09T12:06:49.417 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:49.417 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 37 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:49.417 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:49.417 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 38 2024-04-09T12:06:49.417 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:49.418 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 38 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:49.418 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:49.418 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 39 2024-04-09T12:06:54.482 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:54.482 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 39 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:54.482 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:54.482 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 40 2024-04-09T12:06:54.482 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:54.482 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 40 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:54.482 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:49.412+0000 7fb822ffd640 20 client.4422.objecter 2 4.d3a59201 osd.2 exist [writefull 0~5 in=5b] 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:50.284+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:50.284+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:50.284+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:51.284+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:51.284+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:51.284+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:52.284+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:52.284+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:52.284+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:54.483 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:52.284+0000 7fb821ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:53.284+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:53.284+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:53.284+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.284+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.284+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.284+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.355+0000 7fb833aad640 10 client.4422.objecter tick 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.355+0000 7fb833aad640 2 client.4422.objecter tid 2 on osd.2 is laggy 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.355+0000 7fb833aad640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.355+0000 7fb833aad640 10 monclient: _renew_subs 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.355+0000 7fb833aad640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:06:54.484 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.355+0000 7fb833aad640 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=41}) v3 -- 0x7fb8040038b0 con 0x55a93ec55490 2024-04-09T12:06:54.485 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.355+0000 7fb833aad640 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- ping magic: 0 v1 -- 0x7fb804003b00 con 0x55a93ec1add0 2024-04-09T12:06:58.044 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 11 ==== osd_map(41..43 src has 1..4 api_service: [==========] Running 4 tests from 1 test suite. 2024-04-09T12:06:58.044 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [----------] Global test environment set-up. 2024-04-09T12:06:58.044 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [----------] 4 tests from LibRadosService 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5305 ms) 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [ OK ] LibRadosService.RegisterLate (149 ms) 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: cluster: 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: id: 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: health: HEALTH_WARN 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 5 pool(s) do not have an application enabled 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: services: 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: mgr: x(active, since 2m), standbys: y 2024-04-09T12:06:58.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: osd: 8 osds: 8 up (since 80s), 8 in (since 2m) 2024-04-09T12:06:58.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-04-09T12:06:58.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 2024-04-09T12:06:58.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: data: 2024-04-09T12:06:58.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: pools: 26 pools, 777 pgs 2024-04-09T12:06:58.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: objects: 2 objects, 449 KiB 2024-04-09T12:06:58.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2024-04-09T12:06:58.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: pgs: 87.259% pgs unknown 2024-04-09T12:06:58.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 11.583% pgs not active 2024-04-09T12:06:58.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 678 unknown 2024-04-09T12:06:58.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 90 creating+peering 2024-04-09T12:06:58.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 9 active+clean 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: cluster: 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: id: 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: health: HEALTH_WARN 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 9 pool(s) do not have an application enabled 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: services: 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: mgr: x(active, since 2m), standbys: y 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: osd: 8 osds: 8 up (since 82s), 8 in (since 2m) 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-04-09T12:06:58.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-04-09T12:06:58.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 2024-04-09T12:06:58.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: data: 2024-04-09T12:06:58.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: pools: 29 pools, 849 pgs 2024-04-09T12:06:58.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: objects: 2 objects, 449 KiB 2024-04-09T12:06:58.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2024-04-09T12:06:58.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: pgs: 59.600% pgs unknown 2024-04-09T12:06:58.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 39.340% pgs not active 2024-04-09T12:06:58.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 506 unknown 2024-04-09T12:06:58.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 330 creating+peering 2024-04-09T12:06:58.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 9 active+clean 2024-04-09T12:06:58.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 4 creating+activating 2024-04-09T12:06:58.050 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 2024-04-09T12:06:58.050 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 2024-04-09T12:06:58.050 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [ OK ] LibRadosService.StatusFormat (3102 ms) 2024-04-09T12:06:58.050 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [ RUN ] LibRadosService.Status 2024-04-09T12:06:58.050 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [ OK ] LibRadosService.Status (20059 ms) 2024-04-09T12:06:58.050 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [----------] 4 tests from LibRadosService (28615 ms total) 2024-04-09T12:06:58.050 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: 2024-04-09T12:06:58.050 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [----------] Global test environment tear-down 2024-04-09T12:06:58.050 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [==========] 4 tests from 1 test suite ran. (28615 ms total) 2024-04-09T12:06:58.050 INFO:tasks.workunit.client.0.smithi029.stdout: api_service: [ PASSED ] 4 tests. 2024-04-09T12:06:58.286 INFO:tasks.workunit.client.0.smithi029.stdout:3) v4 ==== 2632+0+0 (secure 0 0 0) 0x7fb82c0536b0 con 0x55a93ec55490 2024-04-09T12:06:58.286 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(41..43 src has 1..43) v4 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [41,43] > 40 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 41 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 41 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 42 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 42 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 43 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:58.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 43 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:58.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:58.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:06:58.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:54.480+0000 7fb822ffd640 20 client.4422.objecter 2 4.d3a59201 osd.2 exist [writefull 0~5 in=5b] 2024-04-09T12:06:58.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:55.284+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:58.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:55.284+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:58.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:55.284+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:58.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:56.045+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 1 ==== osd_map(28..41 src has 1..41) v4 ==== 20026+0+0 (crc 0 0 0) 0x7fb82800b7b0 con 0x55a93ec1add0 2024-04-09T12:06:58.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:56.045+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(28..41 src has 1..41) v4 2024-04-09T12:06:58.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:56.045+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map ignoring epochs [28,41] <= 43 2024-04-09T12:06:58.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:56.045+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:06:58.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:56.045+0000 7fb822ffd640 20 client.4422.objecter 2 4.d3a59201 osd.2 exist [writefull 0~5 in=5b] 2024-04-09T12:06:58.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:56.284+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:58.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:56.284+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:58.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:56.284+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:58.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:57.284+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:58.290 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:57.284+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:58.290 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:57.284+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:59.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:58.284+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:59.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:58.284+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:59.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:58.284+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:59.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.285+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:06:59.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.285+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:06:59.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.285+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:06:59.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.356+0000 7fb833aad640 10 client.4422.objecter tick 2024-04-09T12:06:59.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.356+0000 7fb833aad640 2 client.4422.objecter tid 2 on osd.2 is laggy 2024-04-09T12:06:59.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.356+0000 7fb833aad640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-09T12:06:59.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.356+0000 7fb833aad640 10 monclient: _renew_subs 2024-04-09T12:06:59.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.356+0000 7fb833aad640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-04-09T12:06:59.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.356+0000 7fb833aad640 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=44}) v3 -- 0x7fb8040038b0 con 0x55a93ec55490 2024-04-09T12:06:59.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.356+0000 7fb833aad640 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- ping magic: 0 v1 -- 0x7fb804003c90 con 0x55a93ec1add0 2024-04-09T12:06:59.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== mon.0 v2:172.21.15.29:3300/0 12 ==== osd_map(44..48 src has 1..48) v4 ==== 5614+0+0 (secure 0 0 0) 0x7fb82c057200 con 0x55a93ec55490 2024-04-09T12:06:59.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(44..48 src has 1..48) v4 2024-04-09T12:06:59.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [44,48] > 43 2024-04-09T12:06:59.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 44 2024-04-09T12:06:59.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:59.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 44 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:59.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:59.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 45 2024-04-09T12:06:59.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:59.373 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 45 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:59.373 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:59.373 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 46 2024-04-09T12:06:59.373 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:59.373 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 46 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:59.373 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:59.373 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 47 2024-04-09T12:06:59.373 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:59.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 47 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:59.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:59.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 48 2024-04-09T12:06:59.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 10 client.4422.objecter checking op 2 2024-04-09T12:06:59.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 48 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:06:59.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:59.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:06:59.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.368+0000 7fb822ffd640 20 client.4422.objecter 2 4.d3a59201 osd.2 exist [writefull 0~5 in=5b] 2024-04-09T12:06:59.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 2 ==== osd_op_reply(2 exist [writefull 0~5] v41'1 uv1 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:06:59.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(2 exist [writefull 0~5] v41'1 uv1 ondisk = 0) v8 2024-04-09T12:06:59.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:06:59.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 2 ondisk uv 1 in 4.1 attempt 0 2024-04-09T12:06:59.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:06:59.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 2 2024-04-09T12:06:59.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb83204a640 15 client.4422.objecter _finish_op 2 2024-04-09T12:06:59.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:06:59.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 2 2024-04-09T12:06:59.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:06:59.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-04-09T12:06:59.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 10 librados: Objecter returned from writefull r=0 2024-04-09T12:06:59.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed814e0 2024-04-09T12:06:59.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 48 base exist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:06:59.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:06:59.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:06:59.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:06:59.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [read 0~256] tid 3 osd.2 2024-04-09T12:06:59.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:06:59.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 3 2024-04-09T12:06:59.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 15 client.4422.objecter _send_op 3 to 4.1 on osd.2 2024-04-09T12:07:01.225 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:3 4.1 4:8049a5cb:::exist:head [read 0~256] snapc 0=[] api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-04-09T12:07:01.225 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [----------] Global test environment set-up. 2024-04-09T12:07:01.225 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-04-09T12:07:01.225 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5339 ms) 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (414 ms) 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20569 ms) 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: attempt 0 of 20 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5460 ms) 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (31782 ms total) 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [----------] Global test environment tear-down 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (31782 ms total) 2024-04-09T12:07:01.226 INFO:tasks.workunit.client.0.smithi029.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-04-09T12:07:02.093 INFO:tasks.workunit.client.0.smithi029.stdout:ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x55a93ed88b30 con 0x55a93ec1add0 2024-04-09T12:07:02.094 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:02.094 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:02.094 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed88f20 2024-04-09T12:07:02.094 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 48 base noexist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:02.094 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 20 client.4422.objecter _calc_target target noexist @4 -> pgid 4.a7bbaa1 2024-04-09T12:07:02.094 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.a7bbaa1 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:02.094 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 10 client.4422.objecter _op_submit oid noexist '@4' '@4' [read 0~256] tid 4 osd.2 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 4 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 15 client.4422.objecter _send_op 4 to 4.1 on osd.2 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:4 4.1 4:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x55a93ec193a0 con 0x55a93ec1add0 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:06:59.725+0000 7fb833f78780 5 client.4422.objecter 2 in flight 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:00.285+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:00.285+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:00.285+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:01.285+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:01.285+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:02.095 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:01.285+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 3 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 3 ondisk uv 1 in 4.1 attempt 0 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 5 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 3 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 15 client.4422.objecter _finish_op 3 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 3 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 5 client.4422.objecter 1 in flight 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 4 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:02.096 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 4 ondisk uv 0 in 4.1 attempt 0 2024-04-09T12:07:02.097 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 10 client.4422.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-09T12:07:02.097 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:02.097 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 4 2024-04-09T12:07:02.097 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 15 client.4422.objecter _finish_op 4 2024-04-09T12:07:02.097 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:02.097 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 4 2024-04-09T12:07:02.097 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:02.097 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (2366 ms) 2024-04-09T12:07:02.097 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-04-09T12:07:02.097 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed814e0 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 48 base exist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [read 0~256] tid 5 osd.2 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 5 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 15 client.4422.objecter _send_op 5 to 4.1 on osd.2 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:5 4.1 4:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x55a93ed88f20 con 0x55a93ec1add0 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ec19750 2024-04-09T12:07:02.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 48 base noexist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:02.199 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:02:55.828 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:02.204 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:02:55.833 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:02.241 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 20 client.4422.objecter _calc_target target noexist @4 -> pgid 4.a7bbaa1 2024-04-09T12:07:02.241 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.a7bbaa1 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:02.241 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:02.241 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 10 client.4422.objecter _op_submit oid noexist '@4' '@4' [read 0~256] tid 6 osd.2 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 6 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 15 client.4422.objecter _send_op 6 to 4.1 on osd.2 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:6 4.1 4:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x55a93ed893f0 con 0x55a93ec1add0 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.092+0000 7fb833f78780 5 client.4422.objecter 2 in flight 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.168+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.168+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.168+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.168+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 5 ondisk uv 1 in 4.1 attempt 0 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.168+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 5 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.168+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 5 2024-04-09T12:07:02.242 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.168+0000 7fb83204a640 15 client.4422.objecter _finish_op 5 2024-04-09T12:07:02.243 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.168+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:02.243 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.168+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 5 2024-04-09T12:07:02.243 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.168+0000 7fb83204a640 5 client.4422.objecter 1 in flight 2024-04-09T12:07:02.243 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (148 ms) 2024-04-09T12:07:02.243 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-04-09T12:07:02.243 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.239+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 6 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:02.243 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.239+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-04-09T12:07:02.243 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.239+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:02.243 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.239+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 6 ondisk uv 0 in 4.1 attempt 0 2024-04-09T12:07:02.243 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.239+0000 7fb83204a640 10 client.4422.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-09T12:07:02.243 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.239+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:02.260 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:02:55.888 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:02.262 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:02:55.891 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:02.286 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:55.915 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.239+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 6 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.239+0000 7fb83204a640 15 client.4422.objecter _finish_op 6 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.239+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.239+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 6 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.239+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed814e0 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 48 base exist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [read 0~256] tid 7 osd.2 2024-04-09T12:07:02.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 7 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 15 client.4422.objecter _send_op 7 to 4.1 on osd.2 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:7 4.1 4:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x55a93ec19dc0 con 0x55a93ec1add0 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93eddc7f0 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 48 base noexist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 20 client.4422.objecter _calc_target target noexist @4 -> pgid 4.a7bbaa1 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.a7bbaa1 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 10 client.4422.objecter _op_submit oid noexist '@4' '@4' [read 0~256] tid 8 osd.2 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:02.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 8 2024-04-09T12:07:02.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 15 client.4422.objecter _send_op 8 to 4.1 on osd.2 2024-04-09T12:07:02.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:8 4.1 4:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x55a93eddcce0 con 0x55a93ec1add0 2024-04-09T12:07:02.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:02.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.240+0000 7fb833f78780 5 client.4422.objecter 2 in flight 2024-04-09T12:07:02.292 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:55.921 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:02.408 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:02:56.037 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:02.436 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:56.065 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:02.479 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:02:56.107 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:03.216 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.285+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:03.216 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.285+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:03.216 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.285+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:03.216 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:02.285+0000 7fb821ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:07:03.216 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (975 ms) 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 7 ondisk uv 1 in 4.1 attempt 0 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 5 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 7 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 15 client.4422.objecter _finish_op 7 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 7 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 5 client.4422.objecter 1 in flight 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 8 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:03.217 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 8 ondisk uv 0 in 4.1 attempt 0 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 10 client.4422.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 8 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 15 client.4422.objecter _finish_op 8 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 8 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 20 librados: queue_aio_write 0x55a93ebc7f50 completion 0x55a93ec1a1e0 write_seq 1 2024-04-09T12:07:03.218 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed814e0 2024-04-09T12:07:03.251 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:03.237+0000 12c5f640 -1 osd.4 50 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4473.0:2 14.1a 14.db6ee63a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:04.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 48 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:04.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:04.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:04.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:04.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [write 0~5 in=5b] tid 9 osd.2 2024-04-09T12:07:04.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:04.287 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 9 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 15 client.4422.objecter _send_op 9 to 4.1 on osd.2 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:9 4.1 4:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x55a93ec19750 con 0x55a93ec1add0 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.214+0000 7fb833f78780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.285+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.285+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.285+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 9 ==== osd_map(49..50 src has 1..50) v4 ==== 1662+0+0 (crc 0 0 0) 0x7fb828014d50 con 0x55a93ec1add0 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(49..50 src has 1..50) v4 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [49,50] > 48 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 49 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 10 client.4422.objecter checking op 9 2024-04-09T12:07:04.288 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 49 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:04.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:04.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 50 2024-04-09T12:07:04.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 10 client.4422.objecter checking op 9 2024-04-09T12:07:04.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 50 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:04.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:04.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:07:04.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:03.821+0000 7fb822ffd640 20 client.4422.objecter 9 4.d3a59201 osd.2 exist [write 0~5 in=5b] 2024-04-09T12:07:04.289 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:04.285+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:04.523 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:04.444+0000 12c5f640 -1 osd.4 51 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4473.0:2 14.1a 14.db6ee63a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:05.641 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:05.610+0000 12c5f640 -1 osd.4 52 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4473.0:2 14.1a 14.db6ee63a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:06.627 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:06.595+0000 12c5f640 -1 osd.4 52 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4473.0:2 14.1a 14.db6ee63a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:07.014 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:07:06.945+0000 ec57640 -1 osd.6 53 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4513.0:1 28.1s0 28:87eeef0e:test-rados-api-smithi029-41228-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-04-09T12:07:08.042 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:07:07.965+0000 ec57640 -1 osd.6 54 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4513.0:1 28.1s0 28:87eeef0e:test-rados-api-smithi029-41228-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-04-09T12:07:08.147 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:08.136+0000 12c5f640 -1 osd.4 53 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4473.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~233 in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:08.294 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:04.285+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:08.294 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:04.285+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:08.294 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:04.357+0000 7fb833aad640 10 client.4422.objecter tick 2024-04-09T12:07:08.294 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:05.285+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:05.285+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:05.285+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:06.285+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:06.285+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:06.285+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:07.286+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:07.286+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:07.286+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.286+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.286+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.286+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 10 ==== osd_op_reply(9 exist [write 0~5] v50'2 uv2 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(9 exist [write 0~5] v50'2 uv2 ondisk = 0) v8 2024-04-09T12:07:08.295 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 9 ondisk uv 2 in 4.1 attempt 0 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 9 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb83204a640 15 client.4422.objecter _finish_op 9 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 9 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb83204a640 20 librados: complete_aio_write 0x55a93ec1a1e0 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (5078 ms) 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 20 librados: queue_aio_write 0x55a93ebc7f50 completion 0x55a93ec19b00 write_seq 2 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed814e0 2024-04-09T12:07:08.296 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 50 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:08.297 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:08.297 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:09.025 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:07:09.017+0000 ec57640 -1 osd.6 54 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4513.0:1 28.1s0 28:87eeef0e:test-rados-api-smithi029-41228-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-04-09T12:07:09.191 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:09.133+0000 12c5f640 -1 osd.4 54 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4473.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~233 in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:09.291 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:09.291 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [write 0~5 in=5b] tid 10 osd.2 2024-04-09T12:07:09.291 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:09.291 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 10 2024-04-09T12:07:09.291 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 15 client.4422.objecter _send_op 10 to 4.1 on osd.2 2024-04-09T12:07:09.292 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:10 4.1 4:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) v8 -- 0x55a93ec19750 con 0x55a93ec1add0 2024-04-09T12:07:09.292 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:09.292 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:09.292 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.293+0000 7fb833f78780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-04-09T12:07:09.292 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 11 ==== osd_map(51..53 src has 1..53) v4 ==== 1241+0+0 (crc 0 0 0) 0x7fb828014bb0 con 0x55a93ec1add0 2024-04-09T12:07:09.292 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(51..53 src has 1..53) v4 2024-04-09T12:07:09.292 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [51,53] > 50 2024-04-09T12:07:09.292 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 51 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 10 client.4422.objecter checking op 10 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 51 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 52 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 10 client.4422.objecter checking op 10 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 52 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 53 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 10 client.4422.objecter checking op 10 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 53 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:07:09.293 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:08.369+0000 7fb822ffd640 20 client.4422.objecter 10 4.d3a59201 osd.2 exist [write 0~5 in=5b] 2024-04-09T12:07:09.294 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:09.286+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:09.294 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:09.286+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:10.049 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:07:10.045+0000 ec57640 -1 osd.6 56 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4513.0:1 28.1s0 28:87eeef0e:test-rados-api-smithi029-41228-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-04-09T12:07:10.106 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:10.101+0000 12c5f640 -1 osd.4 55 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4473.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~233 in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:10.791 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:09.286+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:10.791 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:09.358+0000 7fb833aad640 10 client.4422.objecter tick 2024-04-09T12:07:10.791 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.286+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:10.791 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.286+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:10.791 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.286+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:10.791 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 12 ==== osd_op_reply(10 exist [write 0~5] v53'3 uv3 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:10.791 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(10 exist [write 0~5] v53'3 uv3 ondisk = 0) v8 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 10 ondisk uv 3 in 4.1 attempt 0 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 10 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb83204a640 15 client.4422.objecter _finish_op 10 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 10 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb83204a640 20 librados: complete_aio_write 0x55a93ec19b00 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (2497 ms) 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-04-09T12:07:10.792 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 20 librados: queue_aio_write 0x55a93ebc7f50 completion 0x55a93ec19950 write_seq 3 2024-04-09T12:07:10.793 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed814e0 2024-04-09T12:07:10.793 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 53 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:10.793 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:10.793 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:10.793 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:10.793 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [write 0~5 in=5b] tid 11 osd.2 2024-04-09T12:07:10.793 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:10.793 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 11 2024-04-09T12:07:10.793 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 15 client.4422.objecter _send_op 11 to 4.1 on osd.2 2024-04-09T12:07:10.793 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:11 4.1 4:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x55a93edbf9c0 con 0x55a93ec1add0 2024-04-09T12:07:10.793 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:11.369 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:11.360+0000 12c5f640 -1 osd.4 56 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4473.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~233 in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:12.124 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:12.125 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.789+0000 7fb833f78780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-04-09T12:07:12.125 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 13 ==== osd_map(54..55 src has 1..55) v4 ==== 1303+0+0 (crc 0 0 0) 0x7fb828014bf0 con 0x55a93ec1add0 2024-04-09T12:07:12.125 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(54..55 src has 1..55) v4 2024-04-09T12:07:12.125 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [54,55] > 53 2024-04-09T12:07:12.125 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 54 2024-04-09T12:07:12.125 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 10 client.4422.objecter checking op 11 2024-04-09T12:07:12.126 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 54 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:12.126 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:12.126 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 55 2024-04-09T12:07:12.126 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 10 client.4422.objecter checking op 11 2024-04-09T12:07:12.126 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 55 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:12.126 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:12.127 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:07:12.127 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:10.926+0000 7fb822ffd640 20 client.4422.objecter 11 4.d3a59201 osd.2 exist [write 0~5 in=5b] 2024-04-09T12:07:12.127 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:11.286+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:12.127 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:11.286+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:12.127 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:11.286+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:12.127 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 14 ==== osd_op_reply(11 exist [write 0~5] v55'4 uv4 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:12.127 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(11 exist [write 0~5] v55'4 uv4 ondisk = 0) v8 2024-04-09T12:07:12.127 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:12.128 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 11 ondisk uv 4 in 4.1 attempt 0 2024-04-09T12:07:12.128 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:12.128 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 11 2024-04-09T12:07:12.128 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb83204a640 15 client.4422.objecter _finish_op 11 2024-04-09T12:07:12.128 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.128 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 11 2024-04-09T12:07:12.128 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:12.128 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb83204a640 20 librados: complete_aio_write 0x55a93ec19950 2024-04-09T12:07:12.128 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (1334 ms) 2024-04-09T12:07:12.128 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-04-09T12:07:12.201 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed9c7d0 2024-04-09T12:07:12.201 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 55 base exist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:12.201 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:12.201 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:12.201 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:12.201 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [read 0~0] tid 12 osd.2 2024-04-09T12:07:12.201 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:12.201 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 12 2024-04-09T12:07:12.201 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 15 client.4422.objecter _send_op 12 to 4.1 on osd.2 2024-04-09T12:07:12.201 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:12 4.1 4:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55) v8 -- 0x55a93ed9ccc0 con 0x55a93ec1add0 2024-04-09T12:07:12.201 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed9d180 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 55 base noexist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 20 client.4422.objecter _calc_target target noexist @4 -> pgid 4.a7bbaa1 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.a7bbaa1 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 10 client.4422.objecter _op_submit oid noexist '@4' '@4' [read 0~0] tid 13 osd.2 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 13 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 15 client.4422.objecter _send_op 13 to 4.1 on osd.2 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:13 4.1 4:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55) v8 -- 0x55a93edbff30 con 0x55a93ec1add0 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:12.202 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.123+0000 7fb833f78780 5 client.4422.objecter 2 in flight 2024-04-09T12:07:12.203 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 15 ==== osd_map(56..56 src has 1..57) v4 ==== 1033+0+0 (crc 0 0 0) 0x7fb828014ae0 con 0x55a93ec1add0 2024-04-09T12:07:12.203 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(56..56 src has 1..57) v4 2024-04-09T12:07:12.426 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:12.407+0000 12c5f640 -1 osd.4 57 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4473.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~233 in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 16 ==== osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [56,56] > 55 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 56 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 10 client.4422.objecter checking op 12 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 56 base exist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 10 client.4422.objecter checking op 13 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 56 base noexist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 20 client.4422.objecter _calc_target target noexist @4 -> pgid 4.a7bbaa1 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 20 client.4422.objecter 12 4.d3a59201 osd.2 exist [read 0~0] 2024-04-09T12:07:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb822ffd640 20 client.4422.objecter 13 4.a7bbaa1 osd.2 noexist [read 0~0] 2024-04-09T12:07:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 12 ondisk uv 4 in 4.1 attempt 0 2024-04-09T12:07:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 5 2024-04-09T12:07:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 12 2024-04-09T12:07:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb83204a640 15 client.4422.objecter _finish_op 12 2024-04-09T12:07:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 12 2024-04-09T12:07:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.199+0000 7fb83204a640 5 client.4422.objecter 1 in flight 2024-04-09T12:07:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.286+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.286+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.286+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.286+0000 7fb821ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 17 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 13 ondisk uv 0 in 4.1 attempt 0 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb83204a640 10 client.4422.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 13 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb83204a640 15 client.4422.objecter _finish_op 13 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 13 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (342 ms) 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed9d180 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 56 base exist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [read 0~0] tid 14 osd.2 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.465+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 14 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 15 client.4422.objecter _send_op 14 to 4.1 on osd.2 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:14 4.1 4:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56) v8 -- 0x55a93ed9c7d0 con 0x55a93ec1add0 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93edbff30 2024-04-09T12:07:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 56 base noexist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 20 client.4422.objecter _calc_target target noexist @4 -> pgid 4.a7bbaa1 2024-04-09T12:07:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.a7bbaa1 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 10 client.4422.objecter _op_submit oid noexist '@4' '@4' [read 0~0] tid 15 osd.2 2024-04-09T12:07:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 15 2024-04-09T12:07:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 15 client.4422.objecter _send_op 15 to 4.1 on osd.2 2024-04-09T12:07:12.637 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:15 4.1 4:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56) v8 -- 0x55a93edc0420 con 0x55a93ec1add0 2024-04-09T12:07:12.638 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:12.638 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.466+0000 7fb833f78780 5 client.4422.objecter 2 in flight 2024-04-09T12:07:12.638 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.635+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 18 ==== osd_map(57..57 src has 1..57) v4 ==== 1035+0+0 (crc 0 0 0) 0x7fb828014ae0 con 0x55a93ec1add0 2024-04-09T12:07:12.638 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.635+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 19 ==== osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:12.638 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.635+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(57..57 src has 1..57) v4 2024-04-09T12:07:12.638 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.635+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2024-04-09T12:07:12.638 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.635+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:12.638 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.635+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [57,57] > 56 2024-04-09T12:07:12.638 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.635+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 57 2024-04-09T12:07:12.638 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.635+0000 7fb822ffd640 10 client.4422.objecter checking op 14 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 57 base exist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb822ffd640 10 client.4422.objecter checking op 15 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 57 base noexist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb822ffd640 20 client.4422.objecter _calc_target target noexist @4 -> pgid 4.a7bbaa1 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb822ffd640 20 client.4422.objecter 14 4.d3a59201 osd.2 exist [read 0~0] 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb822ffd640 20 client.4422.objecter 15 4.a7bbaa1 osd.2 noexist [read 0~0] 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 14 ondisk uv 4 in 4.1 attempt 0 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 5 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 14 2024-04-09T12:07:12.639 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 15 client.4422.objecter _finish_op 14 2024-04-09T12:07:12.640 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:12.640 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 14 2024-04-09T12:07:12.640 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 5 client.4422.objecter 1 in flight 2024-04-09T12:07:12.640 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 20 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:12.640 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-04-09T12:07:12.640 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:12.640 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 15 ondisk uv 0 in 4.1 attempt 0 2024-04-09T12:07:12.640 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 10 client.4422.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-09T12:07:12.640 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:12.640 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 15 2024-04-09T12:07:12.640 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 15 client.4422.objecter _finish_op 15 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 15 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (170 ms) 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed9d180 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 57 base exist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [read 0~0] tid 16 osd.2 2024-04-09T12:07:12.641 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:12.642 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 16 2024-04-09T12:07:12.642 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 15 client.4422.objecter _send_op 16 to 4.1 on osd.2 2024-04-09T12:07:12.642 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:16 4.1 4:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) v8 -- 0x55a93ed9c7d0 con 0x55a93ec1add0 2024-04-09T12:07:12.642 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.642 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:12.642 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93edbf350 2024-04-09T12:07:12.642 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 57 base noexist @4 precalc_pgid 0 pgid 0.0 is_read 2024-04-09T12:07:12.642 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 20 client.4422.objecter _calc_target target noexist @4 -> pgid 4.a7bbaa1 2024-04-09T12:07:12.642 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.a7bbaa1 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:12.642 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.849 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 10 client.4422.objecter _op_submit oid noexist '@4' '@4' [read 0~0] tid 17 osd.2 2024-04-09T12:07:12.849 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.849 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 17 2024-04-09T12:07:12.849 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 15 client.4422.objecter _send_op 17 to 4.1 on osd.2 2024-04-09T12:07:12.849 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:17 4.1 4:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) v8 -- 0x55a93edbf840 con 0x55a93ec1add0 2024-04-09T12:07:12.849 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:12.849 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.636+0000 7fb833f78780 5 client.4422.objecter 2 in flight 2024-04-09T12:07:12.849 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 21 ==== osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:12.849 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2024-04-09T12:07:12.849 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 16 ondisk uv 4 in 4.1 attempt 0 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 5 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 16 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 15 client.4422.objecter _finish_op 16 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 5 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 16 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 5 client.4422.objecter 1 in flight 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 22 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 17 ondisk uv 0 in 4.1 attempt 0 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 10 client.4422.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-09T12:07:12.850 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:12.851 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 17 2024-04-09T12:07:12.851 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 15 client.4422.objecter _finish_op 17 2024-04-09T12:07:12.851 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:12.851 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 17 2024-04-09T12:07:12.851 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:12.851 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (212 ms) 2024-04-09T12:07:13.179 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-04-09T12:07:13.179 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 20 librados: queue_aio_write 0x55a93ebc7f50 completion 0x55a93ed9c7d0 write_seq 4 2024-04-09T12:07:13.180 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed9d180 2024-04-09T12:07:13.180 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 57 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:13.181 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:13.181 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:13.181 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:13.181 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [writefull 0~5 in=5b] tid 18 osd.2 2024-04-09T12:07:13.181 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:13.181 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 18 2024-04-09T12:07:13.181 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 15 client.4422.objecter _send_op 18 to 4.1 on osd.2 2024-04-09T12:07:13.181 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:18 4.1 4:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) v8 -- 0x55a93edc0f20 con 0x55a93ec1add0 2024-04-09T12:07:13.181 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:12.847+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 23 ==== osd_op_reply(18 exist [writefull 0~5] v57'5 uv5 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(18 exist [writefull 0~5] v57'5 uv5 ondisk = 0) v8 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 18 ondisk uv 5 in 4.1 attempt 0 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 18 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb83204a640 15 client.4422.objecter _finish_op 18 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 18 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb83204a640 20 librados: complete_aio_write 0x55a93ed9c7d0 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (330 ms) 2024-04-09T12:07:13.182 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-04-09T12:07:13.183 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 20 librados: queue_aio_write 0x55a93ebc7f50 completion 0x55a93ed9d670 write_seq 5 2024-04-09T12:07:13.183 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed9d180 2024-04-09T12:07:13.614 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:13.485+0000 12c5f640 -1 osd.4 59 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4546.0:2 22.1a 22:5c6776db:::0.obj:head [write 0~28 in=28b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:14.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 57 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:14.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:14.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:14.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:14.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [writefull 0~5 in=5b] tid 19 osd.2 2024-04-09T12:07:14.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:14.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 19 2024-04-09T12:07:14.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 15 client.4422.objecter _send_op 19 to 4.1 on osd.2 2024-04-09T12:07:14.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:19 4.1 4:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) v8 -- 0x55a93ed9c7d0 con 0x55a93ec1add0 2024-04-09T12:07:14.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:14.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.177+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:14.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.286+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:14.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.286+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:14.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:13.286+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:14.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 24 ==== osd_op_reply(19 exist [writefull 0~5] v57'6 uv6 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:14.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(19 exist [writefull 0~5] v57'6 uv6 ondisk = 0) v8 2024-04-09T12:07:14.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:14.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 19 ondisk uv 6 in 4.1 attempt 0 2024-04-09T12:07:14.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:14.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 19 2024-04-09T12:07:14.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb83204a640 15 client.4422.objecter _finish_op 19 2024-04-09T12:07:14.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:14.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 19 2024-04-09T12:07:14.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:14.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb83204a640 20 librados: complete_aio_write 0x55a93ed9d670 2024-04-09T12:07:14.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (964 ms) 2024-04-09T12:07:14.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-04-09T12:07:14.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 20 librados: queue_aio_write 0x55a93ebc7f50 completion 0x55a93edc0f20 write_seq 6 2024-04-09T12:07:14.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 10 client.4422.objecter _op_submit op 0x55a93ed9d180 2024-04-09T12:07:14.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 20 client.4422.objecter _calc_target epoch 57 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:14.573 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:14.472+0000 12c5f640 -1 osd.4 60 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4546.0:2 22.1a 22:5c6776db:::0.obj:head [write 0~28 in=28b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:15.533 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:07:15.519+0000 12c5f640 -1 osd.4 60 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4546.0:2 22.1a 22:5c6776db:::0.obj:head [write 0~28 in=28b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) 2024-04-09T12:07:16.304 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:16.305 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 10 client.4422.objecter _calc_target raw pgid 4.d3a59201 -> actual 4.1 acting [2,3] primary 2 2024-04-09T12:07:16.305 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 20 client.4422.objecter _get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:16.305 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 10 client.4422.objecter _op_submit oid exist '@4' '@4' [writefull 0~5 in=5b] tid 20 osd.2 2024-04-09T12:07:16.305 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 20 client.4422.objecter get_session s=0x55a93eb94920 osd=2 3 2024-04-09T12:07:16.305 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 15 client.4422.objecter _session_op_assign 2 20 2024-04-09T12:07:16.306 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 15 client.4422.objecter _send_op 20 to 4.1 on osd.2 2024-04-09T12:07:16.306 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 --> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] -- osd_op(unknown.0.0:20 4.1 4:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) v8 -- 0x55a93ed9c7d0 con 0x55a93ec1add0 2024-04-09T12:07:16.306 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:16.306 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.141+0000 7fb833f78780 5 client.4422.objecter 1 in flight 2024-04-09T12:07:16.306 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.186+0000 7fb822ffd640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 25 ==== osd_map(58..58 src has 1..60) v4 ==== 304+0+0 (crc 0 0 0) 0x7fb828014670 con 0x55a93ec1add0 2024-04-09T12:07:16.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.186+0000 7fb822ffd640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_map(58..58 src has 1..60) v4 2024-04-09T12:07:16.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.186+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map got epochs [58,58] > 57 2024-04-09T12:07:16.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.186+0000 7fb822ffd640 3 client.4422.objecter handle_osd_map decoding incremental epoch 58 2024-04-09T12:07:16.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.186+0000 7fb822ffd640 10 client.4422.objecter checking op 20 2024-04-09T12:07:16.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.186+0000 7fb822ffd640 20 client.4422.objecter _calc_target epoch 58 base exist @4 precalc_pgid 0 pgid 0.0 is_write 2024-04-09T12:07:16.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.186+0000 7fb822ffd640 20 client.4422.objecter _calc_target target exist @4 -> pgid 4.d3a59201 2024-04-09T12:07:16.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.186+0000 7fb822ffd640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-09T12:07:16.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.186+0000 7fb822ffd640 20 client.4422.objecter 20 4.d3a59201 osd.2 exist [writefull 0~5 in=5b] 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.286+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.286+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.286+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:14.359+0000 7fb833aad640 10 client.4422.objecter tick 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:15.286+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:15.286+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:15.286+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.286+0000 7fb821ffb640 10 monclient: tick 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.286+0000 7fb821ffb640 10 monclient: _check_auth_tickets 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.286+0000 7fb821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.302+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 <== osd.2 v2:172.21.15.29:6800/35237 26 ==== osd_op_reply(20 exist [writefull 0~5] v58'7 uv7 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb828014420 con 0x55a93ec1add0 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.302+0000 7fb83204a640 10 client.4422.objecter ms_dispatch 0x55a93ebbf030 osd_op_reply(20 exist [writefull 0~5] v58'7 uv7 ondisk = 0) v8 2024-04-09T12:07:16.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.302+0000 7fb83204a640 10 client.4422.objecter in handle_osd_op_reply 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.302+0000 7fb83204a640 7 client.4422.objecter handle_osd_op_reply 20 ondisk uv 7 in 4.1 attempt 0 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.302+0000 7fb83204a640 10 client.4422.objecter op 0 rval 0 len 0 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.302+0000 7fb83204a640 15 client.4422.objecter handle_osd_op_reply completed tid 20 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.302+0000 7fb83204a640 15 client.4422.objecter _finish_op 20 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.302+0000 7fb83204a640 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 4 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.302+0000 7fb83204a640 15 client.4422.objecter _session_op_remove 2 20 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.302+0000 7fb83204a640 5 client.4422.objecter 0 in flight 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.302+0000 7fb83204a640 20 librados: complete_aio_write 0x55a93edc0f20 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (2161 ms) 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 10 librados: watch_flush enter 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 10 librados: watch_flush exit 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 10 client.4422.objecter close_session for osd.2 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 >> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] conn(0x55a93ec1add0 msgr2=0x55a93ed81ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:07:16.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.29:6800/35237,v1:172.21.15.29:6801/35237] conn(0x55a93ec1add0 0x55a93ed81ee0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T12:07:16.310 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 20 client.4422.objecter put_session s=0x55a93eb94920 osd=2 1 2024-04-09T12:07:16.310 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 20 client.4422.objecter shutdown clearing up homeless session... 2024-04-09T12:07:16.310 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 10 client.4422.objecter successfully canceled tick 2024-04-09T12:07:16.310 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fb81406a800 msgr2=0x7fb81406ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:07:16.310 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.173:6800/34987,v1:172.21.15.173:6801/34987] conn(0x7fb81406a800 0x7fb81406ccc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb82405a000 tx=0x7fb82400e040 comp rx=0 tx=0).stop 2024-04-09T12:07:16.310 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 10 monclient: shutdown 2024-04-09T12:07:16.310 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 20 monclient: shutdown discarding 0 pending message(s) 2024-04-09T12:07:16.310 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ec55490 msgr2=0x55a93ece6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-09T12:07:16.310 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 1 --2- 172.21.15.29:0/2748023636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a93ec55490 0x55a93ece6c30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb82c008060 tx=0x7fb82c008520 comp rx=0 tx=0).stop 2024-04-09T12:07:16.311 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb83204a640 1 -- 172.21.15.29:0/2748023636 reap_dead start 2024-04-09T12:07:16.311 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 shutdown_connections 2024-04-09T12:07:16.311 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 >> 172.21.15.29:0/2748023636 conn(0x55a93ec15530 msgr2=0x55a93ece4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-09T12:07:16.311 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 shutdown_connections 2024-04-09T12:07:16.311 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 1 -- 172.21.15.29:0/2748023636 wait complete. 2024-04-09T12:07:16.311 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.303+0000 7fb833f78780 1 librados: shutdown 2024-04-09T12:07:16.311 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [----------] 12 tests from AsioRados (16577 ms total) 2024-04-09T12:07:16.311 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: 2024-04-09T12:07:16.311 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [----------] Global test environment tear-down 2024-04-09T12:07:16.311 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (47080 ms total) 2024-04-09T12:07:16.311 INFO:tasks.workunit.client.0.smithi029.stdout: api_asio: [ PASSED ] 12 tests. 2024-04-09T12:07:21.406 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: Running main() from gmock_main.cc 2024-04-09T12:07:21.406 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-04-09T12:07:21.406 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [----------] Global test environment set-up. 2024-04-09T12:07:21.406 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-04-09T12:07:21.406 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-04-09T12:07:21.406 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ OK ] LibRadosPools.PoolList (5457 ms) 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3783 ms) 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3775 ms) 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (5690 ms) 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (4911 ms) 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (6551 ms) 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (7943 ms) 2024-04-09T12:07:21.407 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-04-09T12:07:21.408 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5179 ms) 2024-04-09T12:07:21.408 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-04-09T12:07:21.408 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8859 ms) 2024-04-09T12:07:21.408 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [----------] 9 tests from LibRadosPools (52148 ms total) 2024-04-09T12:07:21.408 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: 2024-04-09T12:07:21.408 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [----------] Global test environment tear-down 2024-04-09T12:07:21.408 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (52148 ms total) 2024-04-09T12:07:21.408 INFO:tasks.workunit.client.0.smithi029.stdout: api_pool: [ PASSED ] 9 tests. 2024-04-09T12:07:22.491 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:03:16.120 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:22.508 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:03:16.137 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:22.542 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:03:16.171 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:22.546 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:03:16.175 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:22.601 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:16.230 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:22.664 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:16.294 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:22.729 INFO:tasks.workunit.client.0.smithi029.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-04-09T12:07:22.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-04-09T12:07:22.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-04-09T12:07:22.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-04-09T12:07:22.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (53245 ms) 2024-04-09T12:07:22.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (53245 ms total) 2024-04-09T12:07:22.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_cls_remote_reads: 2024-04-09T12:07:22.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-04-09T12:07:22.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (53245 ms total) 2024-04-09T12:07:22.730 INFO:tasks.workunit.client.0.smithi029.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-04-09T12:07:22.747 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:03:16.376 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:22.814 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:16.442 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:22.827 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:03:16.456 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:42.708 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:03:36.337 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:42.778 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:03:36.407 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:42.843 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:03:36.472 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:42.846 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:36.475 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:42.852 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:36.481 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:42.861 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:03:36.490 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:42.863 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:03:36.492 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:42.939 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:36.569 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:42.950 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:03:36.578 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:07:51.615 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-04-09T12:07:51.616 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [----------] Global test environment set-up. 2024-04-09T12:07:51.616 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-04-09T12:07:51.616 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-04-09T12:07:51.616 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-04-09T12:07:51.616 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-09T12:07:51.616 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: 2024-04-09T12:07:51.616 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-04-09T12:07:51.616 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-04-09T12:07:51.616 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: 2024-04-09T12:06:29.395+0000 7fd676235780 -1 failed for service _ceph-mon._tcp 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: 2024-04-09T12:06:29.395+0000 7fd676235780 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (187 ms) 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2009 ms) 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2196 ms total) 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d4232d60 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d3ff5440 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d4182190 2024-04-09T12:07:51.617 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d43602a0 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d4360d40 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d43617e0 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d4362230 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d4362d00 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d43637d0 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d4364300 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d4363540 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d43652f0 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d4364060 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d4366230 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 0x5645d4364f90 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: started 15 aios 2024-04-09T12:07:51.618 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d4232d60 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d3ff5440 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d4182190 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d43602a0 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d4360d40 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d43617e0 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d4362230 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d4362d00 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d43637d0 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d4364300 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d4363540 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d43652f0 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d4364060 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d4366230 2024-04-09T12:07:51.619 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: waiting 0x5645d4364f90 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: done. 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (22084 ms) 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (22084 ms total) 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMisc.Exec (11849 ms) 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (8170 ms) 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (30160 ms) 2024-04-09T12:07:51.620 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-04-09T12:07:51.621 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5466 ms) 2024-04-09T12:07:51.621 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-04-09T12:08:07.757 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-04-09T12:08:07.758 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-04-09T12:08:07.758 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-04-09T12:08:07.758 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-04-09T12:08:07.758 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-04-09T12:08:07.758 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (709 ms) 2024-04-09T12:08:07.758 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-04-09T12:08:07.758 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (78 ms) 2024-04-09T12:08:07.758 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-04-09T12:08:07.759 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (97614 ms) 2024-04-09T12:08:07.759 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (98401 ms total) 2024-04-09T12:08:07.759 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: 2024-04-09T12:08:07.759 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-04-09T12:08:07.759 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (98401 ms total) 2024-04-09T12:08:07.759 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-04-09T12:08:07.884 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: Running main() from gmock_main.cc 2024-04-09T12:08:07.884 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-04-09T12:08:07.884 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-04-09T12:08:07.884 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-04-09T12:08:07.884 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-04-09T12:08:07.884 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-04-09T12:08:07.884 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-04-09T12:08:07.884 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (18519 ms) 2024-04-09T12:08:07.884 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-04-09T12:08:07.884 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (31485 ms) 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (3048 ms) 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (1930 ms) 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (2817 ms) 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (5307 ms) 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (2191 ms) 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (1862 ms) 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-04-09T12:08:07.885 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (6284 ms) 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (1869 ms) 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (4165 ms) 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (1180 ms) 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (4097 ms) 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (610 ms) 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (403 ms) 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-04-09T12:08:07.886 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (91 ms) 2024-04-09T12:08:07.887 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (85858 ms total) 2024-04-09T12:08:07.887 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: 2024-04-09T12:08:07.887 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-04-09T12:08:07.887 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (98445 ms total) 2024-04-09T12:08:07.887 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-04-09T12:08:14.399 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: Running main() from gmock_main.cc 2024-04-09T12:08:14.399 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-04-09T12:08:14.399 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [----------] Global test environment set-up. 2024-04-09T12:08:14.399 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (1311 ms) 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (391 ms) 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (96441 ms) 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:02.999072+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi029-41041-6", "tierpool": "test-rados-api-smithi029-41041-7", "force_nonempty": "--force-nonempty" }]': finished 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:03.003762+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi029-40717-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:03.418984+0000 mon.a [INF] from='client.? 172.21.15.29:0/1613621288' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi029-40770-22"}]: dispatch 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:04.059943+0000 mon.a [INF] from='client.? 172.21.15.29:0/1613621288' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi029-40770-22"}]: dispatch 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:04.331876+0000 mon.b [INF] from='client.? 172.21.15.29:0/3195452844' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi029-41041-6", "overlaypool": "test-rados-api-smithi029-41041-7"}]: dispatch 2024-04-09T12:08:14.400 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:04.916069+0000 mon.c [INF] from='client.? 172.21.15.29:0/896584892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi029-41200-7"}]: dispatch 2024-04-09T12:08:14.401 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:05.916049+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi029-41041-6", "overlaypool": "test-rados-api-smithi029-41041-7"}]: dispatch 2024-04-09T12:08:14.401 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:05.920029+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi029-41200-7"}]: dispatch 2024-04-09T12:08:14.401 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:06.684190+0000 mon.a [INF] from='client.? 172.21.15.29:0/1613621288' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi029-40770-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-09T12:08:14.401 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:06.980642+0000 mon.a [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-09T12:08:14.401 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:06.879680+0000 mon.b [INF] from='client.? 172.21.15.29:0/69869597' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi029-41137-7"}]: dispatch 2024-04-09T12:08:14.401 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:07.167202+0000 mon.b [INF] from='client.? 172.21.15.29:0/4107306729' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi029-41249-12"}]: dispatch 2024-04-09T12:08:14.401 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:07.473272+0000 mon.c [INF] from='client.? 172.21.15.29:0/896584892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi029-41200-7"}]: dispatch 2024-04-09T12:08:20.120 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:09.009029+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi029-41200-7"}]: dispatch 2024-04-09T12:08:20.120 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:09.187810+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi029-41041-6", "overlaypool": "test-rados-api-smithi029-41041-7"}]': finished 2024-04-09T12:08:20.120 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:09.210934+0000 mon.a [INF] from='client.? 172.21.15.29:0/1613621288' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi029-40770-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-09T12:08:20.120 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:09.418864+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi029-41137-7"}]: dispatch 2024-04-09T12:08:20.120 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:09.431624+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi029-41249-12"}]: dispatch 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:09.799872+0000 mon.a [INF] from='client.? 172.21.15.29:0/1613621288' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi029-40770-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi029-40770-22"}]: dispatch 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:09.855826+0000 mon.b [INF] from='client.? 172.21.15.29:0/3645668816' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi029-40809-10"}]: dispatch 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:10.004139+0000 client.admin [INF] onexx 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:10.086863+0000 mon.a [INF] from='client.? 172.21.15.29:0/47924209' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:10.310710+0000 mon.b [INF] from='client.? 172.21.15.29:0/2619592606' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi029-40886-10"}]: dispatch 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:10.506504+0000 mon.b [INF] from='client.? 172.21.15.29:0/69869597' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi029-41137-7"}]: dispatch 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:10.520868+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi029-40809-10"}]: dispatch 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:10.854924+0000 mon.b [INF] from='client.? 172.21.15.29:0/4107306729' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi029-41249-12"}]: dispatch 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:11.329055+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi029-40886-10"}]: dispatch 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:11.352901+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi029-41137-7"}]: dispatch 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:11.357921+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi029-41249-12"}]: dispatch 2024-04-09T12:08:20.121 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:10.354425+0000 mon.c [INF] from='client.? 172.21.15.29:0/896584892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi029-41200-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-09T12:08:20.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:11.515391+0000 mon.b [INF] from='client.? 172.21.15.29:0/2657786940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi029-40733-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-09T12:08:20.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:11.986918+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi029-41200-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-09T12:08:20.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:12.025106+0000 mon.b [INF] from='client.? 172.21.15.29:0/1894792704' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi029-40757-16"}]: dispatch 2024-04-09T12:08:20.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:13.406243+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi029-40733-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-09T12:08:20.727 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:13.519123+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi029-40757-16"}]: dispatch 2024-04-09T12:08:20.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:14.061028+0000 mon.a [INF] from='client.? 172.21.15.29:0/47924209' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-04-09T12:08:20.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:14.657036+0000 client.admin [INF] twoxx 2024-04-09T12:08:20.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:14.681433+0000 mon.a [INF] from='client.? 172.21.15.29:0/47924209' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-09T12:08:20.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:13.205311+0000 mon.b [INF] from='client.? 172.21.15.29:0/3645668816' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi029-40809-10"}]: dispatch 2024-04-09T12:08:20.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:13.211341+0000 mon.b [INF] from='client.? 172.21.15.29:0/69869597' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi029-41137-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-09T12:08:20.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:13.608666+0000 mon.b [INF] from='client.? 172.21.15.29:0/2619592606' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi029-40886-10"}]: dispatch 2024-04-09T12:08:20.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:13.650740+0000 mon.b [INF] from='client.? 172.21.15.29:0/4107306729' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi029-41249-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-09T12:08:20.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:15.020663+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi029-40809-10"}]: dispatch 2024-04-09T12:08:20.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:15.025215+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi029-41137-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-09T12:08:20.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:15.030423+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi029-40886-10"}]: dispatch 2024-04-09T12:08:20.728 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:15.035393+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi029-41249-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-09T12:08:24.110 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:15.639625+0000 mon.a [INF] from='client.? 172.21.15.29:0/1613621288' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi029-40770-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi029-40770-22"}]': finished 2024-04-09T12:08:24.110 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:15.641825+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi029-41200-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-09T12:08:24.110 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:16.474039+0000 mon.a [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:17.256188+0000 mon.a [INF] from='client.? 172.21.15.29:0/47924209' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:16.710002+0000 mon.c [INF] from='client.? 172.21.15.29:0/896584892' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi029-41200-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi029-41200-7"}]: dispatch 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:16.741122+0000 mon.b [INF] from='client.? 172.21.15.29:0/1894792704' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi029-40757-16"}]: dispatch 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:16.746222+0000 mon.b [INF] from='client.? 172.21.15.29:0/3645668816' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi029-40809-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:17.255540+0000 mon.b [INF] from='client.? 172.21.15.29:0/2619592606' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi029-40886-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:18.267763+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi029-40757-16"}]: dispatch 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:18.272285+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi029-40809-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:18.314587+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi029-40886-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:18.616392+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi029-41200-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi029-41200-7"}]: dispatch 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:18.743403+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi029-40733-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:18.751426+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi029-41137-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:18.754873+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi029-41249-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-09T12:08:24.111 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:19.756746+0000 client.admin [INF] threexx 2024-04-09T12:08:29.579 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: got: 2024-04-09T12:08:19.765232+0000 mon.a [INF] from='client.? 172.21.15.29:0/47924209' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-09T12:08:29.579 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (22060 ms) 2024-04-09T12:08:29.579 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (120203 ms total) 2024-04-09T12:08:29.579 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: 2024-04-09T12:08:29.579 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [----------] Global test environment tear-down 2024-04-09T12:08:29.579 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (120203 ms total) 2024-04-09T12:08:29.579 INFO:tasks.workunit.client.0.smithi029.stdout: api_cmd: [ PASSED ] 4 tests. 2024-04-09T12:08:39.044 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: Running main() from gmock_main.cc 2024-04-09T12:08:39.044 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-04-09T12:08:39.044 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [----------] Global test environment set-up. 2024-04-09T12:08:39.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-04-09T12:08:39.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: seed 40770 2024-04-09T12:08:39.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-04-09T12:08:39.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-04-09T12:08:39.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-04-09T12:08:39.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (19793 ms) 2024-04-09T12:08:39.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-04-09T12:08:39.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (18198 ms) 2024-04-09T12:08:39.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-04-09T12:08:39.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (1542 ms) 2024-04-09T12:08:39.045 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-04-09T12:08:39.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (6046 ms) 2024-04-09T12:08:39.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-04-09T12:08:39.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (3609 ms) 2024-04-09T12:08:39.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-04-09T12:08:39.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (2777 ms) 2024-04-09T12:08:39.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-04-09T12:08:39.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (1759 ms) 2024-04-09T12:08:39.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-04-09T12:08:39.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (2011 ms) 2024-04-09T12:08:39.046 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-04-09T12:08:39.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (100 ms) 2024-04-09T12:08:39.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-04-09T12:08:39.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (732 ms) 2024-04-09T12:08:39.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-04-09T12:08:39.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (5264 ms) 2024-04-09T12:08:39.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-04-09T12:08:39.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (745 ms) 2024-04-09T12:08:39.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-04-09T12:08:39.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (1398 ms) 2024-04-09T12:08:39.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-04-09T12:08:39.047 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (1472 ms) 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (3481 ms) 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (4116 ms) 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (2627 ms) 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (1070 ms) 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (2663 ms) 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (79403 ms total) 2024-04-09T12:08:39.048 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: 2024-04-09T12:08:39.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-04-09T12:08:39.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-04-09T12:08:39.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (7619 ms) 2024-04-09T12:08:39.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-04-09T12:08:39.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (918 ms) 2024-04-09T12:08:39.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-04-09T12:08:39.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (13409 ms) 2024-04-09T12:08:39.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-04-09T12:08:39.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (261 ms) 2024-04-09T12:08:39.049 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-04-09T12:08:42.805 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECP api_watch_notify_pp: Running main() from gmock_main.cc 2024-04-09T12:08:42.805 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-04-09T12:08:42.805 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-04-09T12:08:42.805 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: notify 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (44267 ms) 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (13293 ms) 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (57560 ms total) 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: notify 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (1349 ms) 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-04-09T12:08:42.806 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: notify 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (24644 ms) 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (1827 ms) 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (666 ms) 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: handle_notify cookie 94232939124176 notify_id 459561500679 notifier_gid 4634 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (32703 ms) 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: handle_notify cookie 94232939075760 notify_id 459561500673 notifier_gid 4634 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (199 ms) 2024-04-09T12:08:42.807 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: handle_notify cookie 94232939077904 notify_id 459561500674 notifier_gid 4634 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (495 ms) 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: handle_notify cookie 94232939077904 notify_id 463856467972 notifier_gid 4634 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (1322 ms) 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: handle_notify cookie 94232939077904 notify_id 463856467971 notifier_gid 4634 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (417 ms) 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: handle_notify cookie 94232939077904 notify_id 463856467973 notifier_gid 4634 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (138 ms) 2024-04-09T12:08:42.808 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-04-09T12:08:42.809 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: trying... 2024-04-09T12:08:42.809 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: handle_notify cookie 94232939077904 notify_id 463856467974 notifier_gid 4634 2024-04-09T12:08:42.809 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: timed out 2024-04-09T12:08:45.749 INFO:tasks.ceph.mon.b.smithi173.stderr:2024-04-09T12:08:45.729+0000 10158640 -1 mon.b@1(peon).paxos(paxos updating c 1..356) lease_expire from mon.0 v2:172.21.15.29:3300/0 is 0.175839826s seconds in the past; mons are probably laggy (or possibly clocks are too skewed) 2024-04-09T12:08:46.760 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: fl api_list: [==========] Running 11 tests from 3 test suites. 2024-04-09T12:08:46.760 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [----------] Global test environment set-up. 2024-04-09T12:08:46.760 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [----------] 7 tests from LibRadosList 2024-04-09T12:08:46.760 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ OK ] LibRadosList.ListObjects (84793 ms) 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (861 ms) 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: myset foo1,foo2,foo3 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo1 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo2 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo3 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: myset foo1,foo4,foo5 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo4 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo5 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo1 2024-04-09T12:08:46.761 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: myset foo6,foo7 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo7 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo6 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: ns1:foo4 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: ns1:foo5 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: ns2:foo7 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: ns2:foo6 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: ns1:foo1 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: :foo1 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: :foo2 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: :foo3 2024-04-09T12:08:46.762 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (39806 ms) 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 1 0 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 10 0 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 13 0 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 7 0 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 14 0 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 0 0 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 15 0 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 11 0 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 5 0 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 8 0 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 6 0 2024-04-09T12:08:46.763 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 3 0 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 4 0 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 12 0 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 9 0 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 2 0 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (4641 ms) 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: x cursor=MIN 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=1 cursor=17:02547ec2:::1:head 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=10 cursor=17:52ea6a34:::10:head 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=13 cursor=17:566253c9:::13:head 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=7 cursor=17:5c6b0b28:::7:head 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=14 cursor=17:62a1935d:::14:head 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=0 cursor=17:6cac518f:::0:head 2024-04-09T12:08:46.764 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=15 cursor=17:863748b0:::15:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=11 cursor=17:89d3ae78:::11:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=5 cursor=17:b29083e3:::5:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=8 cursor=17:bd63b0f1:::8:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=6 cursor=17:c4fdafeb:::6:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=3 cursor=17:cfc208b3:::3:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=4 cursor=17:d83876eb:::4:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=12 cursor=17:de5d7c5f:::12:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=9 cursor=17:e960b815:::9:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > oid=2 cursor=17:f905c69b:::2:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: FIRST> seek to MIN oid=1 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=1 cursor=17:02547ec2:::1:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:02547ec2:::1:head 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:02547ec2:::1:head -> 1 2024-04-09T12:08:46.765 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=10 cursor=17:52ea6a34:::10:head 2024-04-09T12:08:46.766 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:52ea6a34:::10:head 2024-04-09T12:08:46.766 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:52ea6a34:::10:head -> 10 2024-04-09T12:08:46.766 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=13 cursor=17:566253c9:::13:head 2024-04-09T12:08:46.766 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:566253c9:::13:head 2024-04-09T12:08:46.766 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:566253c9:::13:head -> 13 2024-04-09T12:08:46.766 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=7 cursor=17:5c6b0b28:::7:head 2024-04-09T12:08:46.766 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:5c6b0b28:::7:head 2024-04-09T12:08:46.766 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:5c6b0b28:::7:head -> 7 2024-04-09T12:08:49.956 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=14 cursor=17:62a1935d:::14:head 2024-04-09T12:08:49.956 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:62a1935d:::14:head 2024-04-09T12:08:49.956 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:62a1935d:::14:head -> 14 2024-04-09T12:08:49.956 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=0 cursor=17:6cac518f:::0:head 2024-04-09T12:08:49.956 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:6cac518f:::0:head 2024-04-09T12:08:49.956 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:6cac518f:::0:head -> 0 2024-04-09T12:08:49.956 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=15 cursor=17:863748b0:::15:head 2024-04-09T12:08:49.956 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:863748b0:::15:head 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:863748b0:::15:head -> 15 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=11 cursor=17:89d3ae78:::11:head 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:89d3ae78:::11:head 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:89d3ae78:::11:head -> 11 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=5 cursor=17:b29083e3:::5:head 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:b29083e3:::5:head 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:b29083e3:::5:head -> 5 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=8 cursor=17:bd63b0f1:::8:head 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:bd63b0f1:::8:head 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:bd63b0f1:::8:head -> 8 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=6 cursor=17:c4fdafeb:::6:head 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:c4fdafeb:::6:head 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:c4fdafeb:::6:head -> 6 2024-04-09T12:08:49.957 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=3 cursor=17:cfc208b3:::3:head 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:cfc208b3:::3:head 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:cfc208b3:::3:head -> 3 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=4 cursor=17:d83876eb:::4:head 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:d83876eb:::4:head 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:d83876eb:::4:head -> 4 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=12 cursor=17:de5d7c5f:::12:head 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:de5d7c5f:::12:head 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:de5d7c5f:::12:head -> 12 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=9 cursor=17:e960b815:::9:head 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:e960b815:::9:head 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:e960b815:::9:head -> 9 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : oid=2 cursor=17:f905c69b:::2:head 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:f905c69b:::2:head 2024-04-09T12:08:49.958 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:f905c69b:::2:head -> 2 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:566253c9:::13:head 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:566253c9:::13:head expected=17:566253c9:::13:head 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:566253c9:::13:head -> 13 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=13 expected=13 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:52ea6a34:::10:head 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:52ea6a34:::10:head expected=17:52ea6a34:::10:head 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:52ea6a34:::10:head -> 10 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=10 expected=10 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:f905c69b:::2:head 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:f905c69b:::2:head expected=17:f905c69b:::2:head 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:f905c69b:::2:head -> 2 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=2 expected=2 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:e960b815:::9:head 2024-04-09T12:08:49.959 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:e960b815:::9:head expected=17:e960b815:::9:head 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:e960b815:::9:head -> 9 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=9 expected=9 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:de5d7c5f:::12:head 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:de5d7c5f:::12:head expected=17:de5d7c5f:::12:head 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:de5d7c5f:::12:head -> 12 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=12 expected=12 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:d83876eb:::4:head 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:d83876eb:::4:head expected=17:d83876eb:::4:head 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:d83876eb:::4:head -> 4 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=4 expected=4 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:cfc208b3:::3:head 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:cfc208b3:::3:head expected=17:cfc208b3:::3:head 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:cfc208b3:::3:head -> 3 2024-04-09T12:08:49.960 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=3 expected=3 2024-04-09T12:08:49.961 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:c4fdafeb:::6:head 2024-04-09T12:08:49.961 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:c4fdafeb:::6:head expected=17:c4fdafeb:::6:head 2024-04-09T12:08:49.961 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:c4fdafeb:::6:head -> 6 2024-04-09T12:09:03.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_l open_pools_parallel: process_1_[41531]: starting. 2024-04-09T12:09:03.078 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_1_[41531]: creating pool ceph_test_rados_open_pools_parallel.smithi029-41512 2024-04-09T12:09:03.078 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_1_[41531]: created object 0... 2024-04-09T12:09:03.078 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_1_[41531]: created object 25... 2024-04-09T12:09:03.078 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_1_[41531]: created object 49... 2024-04-09T12:09:03.078 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_1_[41531]: finishing. 2024-04-09T12:09:03.078 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_1_[41531]: shutting down. 2024-04-09T12:09:03.078 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_2_[41532]: starting. 2024-04-09T12:09:03.078 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_2_[41532]: rados_pool_create. 2024-04-09T12:09:03.078 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_2_[41532]: rados_ioctx_create. 2024-04-09T12:09:03.078 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_2_[41532]: shutting down. 2024-04-09T12:09:03.078 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: ******************************* 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_3_[58758]: starting. 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_3_[58758]: creating pool ceph_test_rados_open_pools_parallel.smithi029-41512 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_3_[58758]: created object 0... 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_3_[58758]: created object 25... 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_3_[58758]: created object 49... 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_3_[58758]: finishing. 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_3_[58758]: shutting down. 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: ******************************* 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_4_[58759]: starting. 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_4_[58759]: rados_pool_create. 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_4_[58759]: rados_ioctx_create. 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: process_4_[58759]: shutting down. 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: ******************************* 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: ******************************* 2024-04-09T12:09:03.079 INFO:tasks.workunit.client.0.smithi029.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-04-09T12:09:03.995 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_1_[41529]: starting. 2024-04-09T12:09:03.995 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_1_[41529]: creating pool ceph_test_rados_delete_pools_parallel.smithi029-41509 2024-04-09T12:09:03.995 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_1_[41529]: created object 0... 2024-04-09T12:09:03.995 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_1_[41529]: created object 25... 2024-04-09T12:09:03.995 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_1_[41529]: created object 49... 2024-04-09T12:09:03.995 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_1_[41529]: finishing. 2024-04-09T12:09:03.995 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_1_[41529]: shutting down. 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_2_[41530]: starting. 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_2_[41530]: deleting pool ceph_test_rados_delete_pools_parallel.smithi029-41509 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_2_[41530]: shutting down. 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: ******************************* 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_3_[61669]: starting. 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_3_[61669]: creating pool ceph_test_rados_delete_pools_parallel.smithi029-41509 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_3_[61669]: created object 0... 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_3_[61669]: created object 25... 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_3_[61669]: created object 49... 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_3_[61669]: finishing. 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_3_[61669]: shutting down. 2024-04-09T12:09:03.996 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: ******************************* 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_5_[61671]: starting. 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_5_[61671]: listing objects. 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_5_[61671]: listed object 0... 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_5_[61671]: listed object 25... 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_5_[61671]: saw 50 objects 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_5_[61671]: shutting down. 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: ******************************* 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_4_[61670]: starting. 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_4_[61670]: deleting pool ceph_test_rados_delete_pools_parallel.smithi029-41509 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: process_4_[61670]: shutting down. 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: ******************************* 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: ******************************* 2024-04-09T12:09:03.997 INFO:tasks.workunit.client.0.smithi029.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-04-09T12:09:03.998 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-04-09T12:09:03.998 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-04-09T12:09:03.998 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-04-09T12:09:03.998 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-04-09T12:09:03.998 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (71005 ms) 2024-04-09T12:09:03.998 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [----------] 8 tests from LibRadosMisc (126650 ms total) 2024-04-09T12:09:03.998 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: 2024-04-09T12:09:03.999 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [----------] Global test environment tear-down 2024-04-09T12:09:03.999 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (154780 ms total) 2024-04-09T12:09:03.999 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc: [ PASSED ] 12 tests. 2024-04-09T12:09:04.001 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-04-09T12:09:04.001 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-04-09T12:09:04.001 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify_test_cb 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (37163 ms) 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94258114005120 err -107 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (7339 ms) 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94258114016992 err -107 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (12290 ms) 2024-04-09T12:09:04.002 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_cb from 4445 notify_id 326417514497 cookie 94258114016992 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (2398 ms) 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_cb from 4445 notify_id 335007449090 cookie 94258114016992 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (1679 ms) 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_cb from 4445 notify_id 339302416387 cookie 94258114016992 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (574 ms) 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_cb from 4445 notify_id 339302416388 cookie 94258114016992 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_cb from 4445 notify_id 339302416388 cookie 94258114033840 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (149 ms) 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-04-09T12:09:04.003 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_cb from 4445 notify_id 343597383685 cookie 94258114036128 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_cb from 4445 notify_id 347892350982 cookie 94258114036128 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (5062 ms) 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94258114033840 err -107 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_cb from 4445 notify_id 399431958531 cookie 94258114033840 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (12407 ms) 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94258114033840 err -107 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (3008 ms) 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (82070 ms total) 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: 2024-04-09T12:09:04.004 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-04-09T12:09:04.005 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-04-09T12:09:04.005 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: watch_notify_test_cb 2024-04-09T12:09:04.005 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (6117 ms) 2024-04-09T12:09:04.005 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (6117 ms total) 2024-04-09T12:09:04.005 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: 2024-04-09T12:09:04.005 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-04-09T12:09:04.005 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (154638 ms total) 2024-04-09T12:09:04.005 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-04-09T12:09:04.008 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: Running main() from gmock_main.cc 2024-04-09T12:09:04.008 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-04-09T12:09:04.009 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [----------] Global test environment set-up. 2024-04-09T12:09:04.009 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-04-09T12:09:04.009 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-04-09T12:09:04.009 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ OK ] LibRadosStat.Stat (30827 ms) 2024-04-09T12:09:04.009 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-04-09T12:09:04.009 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (2514 ms) 2024-04-09T12:09:04.009 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-04-09T12:09:04.009 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ OK ] LibRadosStat.StatNS (46815 ms) 2024-04-09T12:09:04.009 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-04-09T12:09:04.010 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (1317 ms) 2024-04-09T12:09:04.010 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-04-09T12:09:04.010 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (1528 ms) 2024-04-09T12:09:04.010 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [----------] 5 tests from LibRadosStat (83001 ms total) 2024-04-09T12:09:04.010 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: 2024-04-09T12:09:04.010 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-04-09T12:09:04.010 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (6182 ms) 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (544 ms) 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (5507 ms) 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (3346 ms) 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (15579 ms total) 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [----------] Global test environment tear-down 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (154682 ms total) 2024-04-09T12:09:04.011 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat: [ PASSED ] 9 tests. 2024-04-09T12:09:04.026 INFO:tasks.workunit.client.0.smithi029.stdout:P.RoundTripPP2 (189 ms) 2024-04-09T12:09:04.026 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-04-09T12:09:04.026 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (216 ms) 2024-04-09T12:09:04.026 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-04-09T12:09:04.026 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (1620 ms) 2024-04-09T12:09:04.026 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (411 ms) 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (472 ms) 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (387 ms) 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (169 ms) 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (10475 ms) 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (1978 ms) 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (570 ms) 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-04-09T12:09:04.027 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (451 ms) 2024-04-09T12:09:04.028 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-04-09T12:09:04.028 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (180 ms) 2024-04-09T12:09:04.028 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-04-09T12:09:04.028 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (634 ms) 2024-04-09T12:09:04.028 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (39959 ms total) 2024-04-09T12:09:04.028 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: 2024-04-09T12:09:04.028 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [----------] Global test environment tear-down 2024-04-09T12:09:04.028 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (154861 ms total) 2024-04-09T12:09:04.028 INFO:tasks.workunit.client.0.smithi029.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-04-09T12:09:05.075 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: Running main() from gmock_main.cc 2024-04-09T12:09:05.075 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-04-09T12:09:05.075 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [----------] Global test environment set-up. 2024-04-09T12:09:05.075 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-04-09T12:09:05.075 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-04-09T12:09:05.075 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (41161 ms) 2024-04-09T12:09:05.075 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-04-09T12:09:05.075 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-04-09T12:09:05.075 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-04-09T12:09:05.075 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (26687 ms) 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (15616 ms) 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.Checksum (224 ms) 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (965 ms) 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (174 ms) 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (315 ms) 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (51 ms) 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-04-09T12:09:05.076 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.TruncTest (95 ms) 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (214 ms) 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (128 ms) 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.RmXattr (501 ms) 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIo.XattrIter (248 ms) 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [----------] 14 tests from LibRadosIo (86379 ms total) 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (8000 ms) 2024-04-09T12:09:05.077 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (818 ms) 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (174 ms) 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (154 ms) 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (1494 ms) 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (439 ms) 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (196 ms) 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (215 ms) 2024-04-09T12:09:05.078 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-04-09T12:09:05.079 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (653 ms) 2024-04-09T12:09:05.079 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-04-09T12:09:05.079 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (236 ms) 2024-04-09T12:09:05.079 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [----------] 10 tests from LibRadosIoEC (12379 ms total) 2024-04-09T12:09:05.079 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: 2024-04-09T12:09:05.079 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [----------] Global test environment tear-down 2024-04-09T12:09:05.079 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: [==========] 24 tests from 2 test suites ran. (155915 ms total) 2024-04-09T12:09:05.079 INFO:tasks.workunit.client.0.smithi029.stdout: api_io: api_lock: Running main() from gmock_main.cc 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [----------] Global test environment set-up. 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (25130 ms) 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLock.LockShared (9127 ms) 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (2331 ms) 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (28881 ms) 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-04-09T12:09:05.080 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (19263 ms) 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLock.Unlock (106 ms) 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (193 ms) 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (130 ms) 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [----------] 8 tests from LibRadosLock (85161 ms total) 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (9995 ms) 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (179 ms) 2024-04-09T12:09:05.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1346 ms) 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1956 ms) 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (635 ms) 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (493 ms) 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (504 ms) 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (2063 ms) 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (17171 ms total) 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: 2024-04-09T12:09:05.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [----------] Global test environment tear-down 2024-04-09T12:09:05.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (155892 ms total) 2024-04-09T12:09:05.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock: [ PASSED ] 16 tests. 2024-04-09T12:09:05.083 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 24 tests. 2024-04-09T12:09:05.301 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-04-09T12:09:05.301 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-04-09T12:09:05.301 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-04-09T12:09:05.301 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-04-09T12:09:05.301 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: seed 41200 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (12457 ms) 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (12122 ms) 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (419 ms) 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (22676 ms) 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (31945 ms) 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (79619 ms total) 2024-04-09T12:09:05.302 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (23111 ms) 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (2544 ms) 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (1665 ms) 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (540 ms) 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (27860 ms total) 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (155951 ms total) 2024-04-09T12:09:05.303 INFO:tasks.workunit.client.0.smithi029.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-04-09T12:09:05.306 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-04-09T12:09:05.306 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-04-09T12:09:05.306 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-04-09T12:09:05.306 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: seed 40886 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (37162 ms) 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (4175 ms) 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (17112 ms) 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (25045 ms) 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (831 ms) 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (468 ms) 2024-04-09T12:09:05.307 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (444 ms) 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (239 ms) 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (85476 ms total) 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (13807 ms) 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (247 ms) 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (2071 ms) 2024-04-09T12:09:05.308 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1315 ms) 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (595 ms) 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (320 ms) 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (1183 ms) 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (252 ms) 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (19791 ms total) 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (156089 ms total) 2024-04-09T12:09:05.309 INFO:tasks.workunit.client.0.smithi029.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-04-09T12:09:06.276 INFO:tasks.workunit.client.0.smithi029.stdout:ushing 2024-04-09T12:09:06.276 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: flushed 2024-04-09T12:09:06.276 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3227 ms) 2024-04-09T12:09:06.276 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: trying... 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: handle_notify cookie 94232939077904 notify_id 463856467975 notifier_gid 4634 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: timed out 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: flushing 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: flushed 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3125 ms) 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: List watches 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: notify2 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: handle_notify cookie 94232939077904 notify_id 468151435272 notifier_gid 4634 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: notify2 done 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: watch_check 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: unwatch2 2024-04-09T12:09:06.277 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: flushing 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: done 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (4393 ms) 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: List watches 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: notify2 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: handle_notify cookie 94232939079168 notify_id 472446402564 notifier_gid 4634 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: notify2 done 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: watch_check 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: unwatch2 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: flushing 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: done 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3618 ms) 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (78123 ms total) 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: 2024-04-09T12:09:06.278 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-04-09T12:09:06.279 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (156922 ms total) 2024-04-09T12:09:06.279 INFO:tasks.workunit.client.0.smithi029.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (19972 ms) 2024-04-09T12:09:11.719 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (24193 ms) 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (15398 ms) 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (21363 ms) 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (20791 ms) 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (29307 ms) 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (31259 ms) 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (162284 ms total) 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-04-09T12:09:11.720 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (162284 ms total) 2024-04-09T12:09:11.721 INFO:tasks.workunit.client.0.smithi029.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-04-09T12:09:18.888 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:05:12.517 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:18.902 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:05:12.531 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:18.964 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:05:12.593 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:18.977 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:05:12.606 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:18.981 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:05:12.611 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:18.984 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:05:12.613 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:19.173 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:05:12.802 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:19.192 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:05:12.822 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:19.239 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:05:12.868 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_1_[41526]: starting. 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_1_[41526]: creating pool ceph_test_rados_list_parallel.smithi029-41482 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_1_[41526]: created object 0... 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_1_[41526]: created object 25... 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_1_[41526]: created object 49... 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_1_[41526]: finishing. 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_1_[41526]: shutting down. 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_2_[41527]: starting. 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_2_[41527]: listing objects. 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_2_[41527]: listed object 0... 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_2_[41527]: listed object 25... 2024-04-09T12:09:22.214 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_2_[41527]: saw 50 objects 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_2_[41527]: shutting down. 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_3_[83662]: starting. 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_3_[83662]: creating pool ceph_test_rados_list_parallel.smithi029-41482 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_3_[83662]: created object 0... 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_3_[83662]: created object 25... 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_3_[83662]: created object 49... 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_3_[83662]: finishing. 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_3_[83662]: shutting down. 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_4_[83663]: starting. 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_4_[83663]: listing objects. 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_4_[83663]: listed object 0... 2024-04-09T12:09:22.215 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_4_[83663]: listed object 25... 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_4_[83663]: saw 45 objects 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_4_[83663]: shutting down. 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_5_[83664]: starting. 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_5_[83664]: removed 25 objects... 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_5_[83664]: removed half of the objects 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_5_[83664]: removed 50 objects... 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_5_[83664]: removed 50 objects 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_5_[83664]: shutting down. 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_6_[91681]: starting. 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_6_[91681]: creating pool ceph_test_rados_list_parallel.smithi029-41482 2024-04-09T12:09:22.216 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_6_[91681]: created object 0... 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_6_[91681]: created object 25... 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_6_[91681]: created object 49... 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_6_[91681]: finishing. 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_6_[91681]: shutting down. 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_7_[91682]: starting. 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_7_[91682]: listing objects. 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_7_[91682]: listed object 0... 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_7_[91682]: listed object 25... 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_7_[91682]: listed object 50... 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_7_[91682]: saw 58 objects 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_7_[91682]: shutting down. 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:09:22.217 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:09:22.218 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_8_[91684]: starting. 2024-04-09T12:09:22.218 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_8_[91684]: added 25 objects... 2024-04-09T12:09:22.218 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_8_[91684]: added half of the objects 2024-04-09T12:09:22.218 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_8_[91684]: added 50 objects... 2024-04-09T12:09:22.218 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_8_[91684]: added 50 objects 2024-04-09T12:09:22.218 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_8_[91684]: shutting down. 2024-04-09T12:09:22.218 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:09:22.218 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:09:38.972 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:05:32.601 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:38.974 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:05:32.603 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:38.978 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:05:32.608 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:39.043 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:05:32.673 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:39.066 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:05:32.695 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:39.074 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:05:32.704 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:39.128 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:05:32.758 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:39.145 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:05:32.775 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:39.238 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:05:32.868 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:48.814 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ********************** api_snapshots_pp: Running main() from gmock_main.cc 2024-04-09T12:09:48.814 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-04-09T12:09:48.814 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-04-09T12:09:48.814 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-04-09T12:09:48.814 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: seed 41083 2024-04-09T12:09:48.814 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-04-09T12:09:48.814 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (15779 ms) 2024-04-09T12:09:48.814 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-04-09T12:09:48.815 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (6632 ms) 2024-04-09T12:09:48.815 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-04-09T12:09:48.815 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (11406 ms) 2024-04-09T12:09:48.815 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-04-09T12:09:48.815 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (3399 ms) 2024-04-09T12:09:48.815 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-04-09T12:09:48.815 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (9525 ms) 2024-04-09T12:09:48.815 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (46741 ms total) 2024-04-09T12:09:48.815 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: 2024-04-09T12:09:48.815 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (15628 ms) 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (41236 ms) 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (44490 ms) 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (6625 ms) 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (3742 ms) 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-09T12:09:48.816 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.2.2-1187-gd540ebac/rpm/el9/BUILD/ceph-18.2.2-1187-gd540ebac/src/test/librados/snapshots_cxx.cc:463: Skipped 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: deleting snap 23 in pool LibRadosSnapshotsSelfManagedPP_smithi029-41083-7 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: waiting for snaps to purge 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17994 ms) 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (129716 ms total) 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (8 ms) 2024-04-09T12:09:48.817 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-04-09T12:09:48.818 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (4957 ms) 2024-04-09T12:09:48.818 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (4965 ms total) 2024-04-09T12:09:48.818 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: 2024-04-09T12:09:48.818 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-04-09T12:09:48.818 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-04-09T12:09:48.818 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3193 ms) 2024-04-09T12:09:48.818 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-04-09T12:09:59.059 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:05:52.688 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:59.063 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:05:52.693 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:59.113 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:05:52.742 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:59.115 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:05:52.745 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:59.129 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:05:52.758 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:59.130 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:05:52.760 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:59.139 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:05:52.768 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:59.174 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:05:52.804 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:09:59.187 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:05:52.817 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:00.166 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRado api_snapshots: Running main() from gmock_main.cc 2024-04-09T12:10:00.166 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-04-09T12:10:00.166 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [----------] Global test environment set-up. 2024-04-09T12:10:00.166 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-04-09T12:10:00.166 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-04-09T12:10:00.166 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (44607 ms) 2024-04-09T12:10:00.166 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-04-09T12:10:00.166 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (5537 ms) 2024-04-09T12:10:00.166 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-04-09T12:10:00.167 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (12895 ms) 2024-04-09T12:10:00.167 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-04-09T12:10:00.167 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (3595 ms) 2024-04-09T12:10:00.167 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (66634 ms total) 2024-04-09T12:10:00.167 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: 2024-04-09T12:10:00.167 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-04-09T12:10:00.167 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-04-09T12:10:00.167 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (47675 ms) 2024-04-09T12:10:00.167 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-04-09T12:10:00.167 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (37062 ms) 2024-04-09T12:10:00.167 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-04-09T12:10:00.168 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (16578 ms) 2024-04-09T12:10:00.168 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (101315 ms total) 2024-04-09T12:10:00.168 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: 2024-04-09T12:10:00.168 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-04-09T12:10:00.168 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-04-09T12:10:00.168 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (4190 ms) 2024-04-09T12:10:00.168 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-04-09T12:10:00.168 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2124 ms) 2024-04-09T12:10:00.168 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-04-09T12:10:00.168 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (3160 ms) 2024-04-09T12:10:00.169 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-04-09T12:10:00.169 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2974 ms) 2024-04-09T12:10:00.169 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (12448 ms total) 2024-04-09T12:10:00.169 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: 2024-04-09T12:10:00.169 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-04-09T12:10:00.169 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-04-09T12:10:00.169 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4961 ms) 2024-04-09T12:10:00.170 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-04-09T12:10:00.170 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4819 ms) 2024-04-09T12:10:00.170 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (9780 ms total) 2024-04-09T12:10:00.170 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: 2024-04-09T12:10:00.170 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [----------] Global test environment tear-down 2024-04-09T12:10:00.170 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (210876 ms total) 2024-04-09T12:10:00.171 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-04-09T12:10:18.545 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:18.539+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:18.932 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:18.926+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:18.958 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:06:12.587 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:18.962 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:06:12.591 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:18.985 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:06:12.614 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:19.009 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:12.638 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:19.010 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:12.640 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:19.012 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:06:12.641 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:19.013 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:06:12.643 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:19.032 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:12.662 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:19.035 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:06:12.664 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:19.560 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:19.554+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:19.561 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:19.560+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:19.884 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:19.883+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:20.531 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:20.530+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:20.614 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:20.611+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:20.925 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:20.923+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:21.519 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:21.518+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:21.596 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:21.594+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:21.720 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:21.718+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:21.901 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:21.898+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:22.502 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:22.501+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:22.618 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:22.617+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:22.698 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:22.696+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:22.914 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:22.912+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:23.522 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:23.520+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:23.628 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:23.627+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:23.683 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:23.681+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:23.872 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:23.870+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:24.560 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:24.559+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:24.599 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:24.597+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:24.677 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:24.675+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:24.857 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:24.855+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:25.526 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:25.523+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:25.555 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:25.553+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:25.721 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:25.719+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:25.860 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:25.858+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:26.569 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:26.566+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:26.611 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:26.607+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:26.704 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:26.702+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:26.852 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:26.849+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:27.559 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:27.557+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:27.585 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:27.583+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:27.705 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:27.702+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:27.878 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:27.874+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:28.563 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:28.561+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:28.629 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:28.627+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:28.691 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:28.688+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:28.872 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:28.870+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:29.560 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:29.558+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:29.659 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:29.656+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:29.706 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:29.703+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:29.908 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:29.905+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:30.544 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:30.541+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:30.623 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:30.620+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:30.714 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:30.713+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:30.864 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:30.862+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:31.547 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:31.545+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:31.600 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:31.598+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:31.712 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:31.710+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:31.896 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:31.894+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:32.519 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:32.517+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:32.640 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:32.637+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:32.721 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:32.718+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:32.911 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:32.907+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:33.475 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:33.473+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:33.615 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:33.613+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:33.747 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:33.745+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:33.944 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:33.939+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:34.462 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:34.460+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:34.644 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:34.641+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:34.775 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:34.773+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:34.978 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:34.975+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:35.516 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:35.513+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:35.686 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:35.683+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:35.788 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:35.786+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:35.992 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:35.988+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:36.496 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:36.494+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:36.720 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:36.718+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:36.787 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:36.785+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:36.967 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:36.965+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:37.533 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:37.527+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:37.681 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:37.678+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:37.834 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:37.832+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:37.921 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:37.919+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:38.569 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:38.566+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:38.705 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:38.703+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:38.869 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:38.867+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:38.927 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:38.924+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:39.010 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:06:32.639 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:39.014 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:06:32.644 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:39.053 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:06:32.682 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:39.062 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:32.692 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:39.063 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:32.693 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:39.076 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:06:32.705 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:39.080 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:06:32.710 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:39.087 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:32.717 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:39.105 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:06:32.734 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:39.541 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:39.537+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:39.718 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:39.716+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:39.849 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:39.847+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:39.926 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:39.923+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:40.528 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:40.525+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:40.725 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:40.722+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:40.846 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:40.844+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:40.971 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:40.969+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:41.519 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:41.517+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:41.709 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:41.705+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:41.802 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:41.800+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:41.981 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:41.978+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:42.565 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:42.563+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:42.745 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:42.743+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:42.793 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:42.791+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:42.956 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:42.952+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:43.529 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:43.527+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:43.782 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:43.780+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:43.797 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:43.794+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:43.951 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:43.948+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:44.540 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:44.538+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:44.748 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:44.746+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:44.749 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:44.747+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:44.988 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:44.985+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:45.524 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:45.521+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:45.711 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:45.709+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:45.761 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:45.759+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:45.986 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:45.982+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:46.568 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:46.566+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:46.666 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:46.664+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:46.774 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:46.772+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:46.952 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:46.950+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:47.571 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:47.570+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:47.690 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:47.688+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:47.803 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:47.801+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:47.975 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:47.973+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:48.584 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:48.582+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:48.709 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:48.707+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:48.825 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:48.824+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:49.013 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:49.010+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:49.631 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:49.629+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:49.695 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:49.692+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:49.822 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:49.820+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:49.987 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:49.985+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:50.607 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:50.605+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:50.711 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:50.709+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:50.780 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:50.778+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:50.970 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:50.968+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:51.604 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:51.601+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:51.708 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:51.706+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:51.785 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:51.782+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:52.020 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:52.017+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:52.593 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:52.591+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:52.703 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:52.701+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:52.762 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:52.760+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:53.039 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:53.037+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:53.582 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:53.579+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:53.673 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:53.671+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:53.730 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:53.727+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:54.087 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:54.085+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:54.595 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:54.593+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:54.699 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:54.697+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:54.752 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:54.751+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:55.138 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:55.135+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:55.601 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:55.598+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:55.686 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:55.682+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:55.762 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:55.760+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:56.183 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:56.181+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:56.561 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:56.560+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:56.678 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:56.674+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:56.716 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:56.715+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:57.244 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:57.241+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:57.524 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:57.521+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:57.708 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:57.705+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:57.738 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:57.737+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:58.195 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:58.194+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:58.569 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:58.567+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:58.666 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:58.664+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:58.764 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:58.763+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:10:59.111 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:06:52.740 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:59.116 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:06:52.745 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:59.143 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:06:52.773 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:59.163 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:52.793 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:59.164 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:52.794 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:59.167 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:06:52.797 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:59.168 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:06:52.798 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:59.169 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:10:59.168+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:59.188 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:52.818 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:59.194 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:06:52.824 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:10:59.544 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:10:59.541+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:10:59.637 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:10:59.636+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:10:59.777 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:10:59.776+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:00.169 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:00.168+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:00.494 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:00.493+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:11:00.622 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:00.620+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:00.827 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:00.826+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:01.220 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:01.219+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:01.463 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:01.462+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:11:01.622 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:01.619+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:01.846 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:01.845+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:02.218 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:02.217+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:02.455 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:02.453+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:11:02.630 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:02.629+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:02.826 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:02.825+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:03.208 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:03.207+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:03.451 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:03.450+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:11:03.679 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:03.677+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:03.806 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:03.806+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:04.256 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:04.255+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:04.454 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:04.452+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:11:04.706 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:04.705+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:04.824 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:04.824+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:05.223 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:05.222+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:05.458 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:05.457+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:11:05.744 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:05.743+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:05.800 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:05.798+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:06.245 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:06.244+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:06.504 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:06.502+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:11:06.734 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:06.732+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:06.793 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:06.791+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:07.258 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:07.253+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:07.494 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:07.493+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:11:07.711 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:07.709+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:07.815 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:07.814+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:08.274 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:08.273+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:08.496 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:08.495+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:11:08.712 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:08.710+0000 ec57640 -1 osd.0 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:08.777 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:08.775+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:09.237 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:09.230+0000 ec57640 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:46.099855+0000 front 2024-04-09T12:09:46.178766+0000 (oldest deadline 2024-04-09T12:11:08.688962+0000) 2024-04-09T12:11:09.241 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:09.239+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:09.477 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:09.474+0000 12c5f640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20974.0:7 99.5s0 99:a25cc941:test-rados-api-smithi029-41083-19::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159) 2024-04-09T12:11:09.499 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:11:09.492+0000 12c5f640 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:46.102426+0000 front 2024-04-09T12:09:46.096306+0000 (oldest deadline 2024-04-09T12:11:09.038462+0000) 2024-04-09T12:11:09.785 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:09.781+0000 ec57640 -1 osd.0 173 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:09.799 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:09.796+0000 ec57640 -1 osd.6 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:10.212 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:10.207+0000 ec57640 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:46.099855+0000 front 2024-04-09T12:09:46.178766+0000 (oldest deadline 2024-04-09T12:11:08.688962+0000) 2024-04-09T12:11:10.217 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:10.215+0000 ec57640 -1 osd.2 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:10.239 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:11:10.234+0000 12c5f640 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:47.592749+0000 front 2024-04-09T12:09:47.586917+0000 (oldest deadline 2024-04-09T12:11:09.882045+0000) 2024-04-09T12:11:10.460 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:11:10.454+0000 ec57640 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:44.449159+0000 front 2024-04-09T12:09:44.210637+0000 (oldest deadline 2024-04-09T12:11:09.633528+0000) 2024-04-09T12:11:10.513 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:11:10.511+0000 12c5f640 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:46.102426+0000 front 2024-04-09T12:09:46.096306+0000 (oldest deadline 2024-04-09T12:11:09.038462+0000) 2024-04-09T12:11:10.550 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:10.510+0000 12c5f640 -1 osd.1 173 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:45.135567+0000 front 2024-04-09T12:09:45.121151+0000 (oldest deadline 2024-04-09T12:11:09.808143+0000) 2024-04-09T12:11:10.799 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:10.797+0000 ec57640 -1 osd.6 173 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:10.804 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:10.803+0000 ec57640 -1 osd.0 173 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:11.184 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:11.180+0000 ec57640 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:11:10.992998+0000 front 2024-04-09T12:09:46.178766+0000 (oldest deadline 2024-04-09T12:11:08.688962+0000) 2024-04-09T12:11:11.190 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:11.186+0000 ec57640 -1 osd.2 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:11.201 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:11:11.197+0000 12c5f640 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:11:11.106361+0000 front 2024-04-09T12:09:47.586917+0000 (oldest deadline 2024-04-09T12:11:09.882045+0000) 2024-04-09T12:11:11.459 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:11:11.455+0000 ec57640 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:44.449159+0000 front 2024-04-09T12:09:44.210637+0000 (oldest deadline 2024-04-09T12:11:09.633528+0000) 2024-04-09T12:11:11.471 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:11.470+0000 12c5f640 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:45.135567+0000 front 2024-04-09T12:09:45.121151+0000 (oldest deadline 2024-04-09T12:11:09.808143+0000) 2024-04-09T12:11:11.770 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:11.765+0000 ec57640 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:11:11.677443+0000 front 2024-04-09T12:09:45.765331+0000 (oldest deadline 2024-04-09T12:11:11.736326+0000) 2024-04-09T12:11:11.770 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:11.768+0000 ec57640 -1 osd.6 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:11.773 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:11.766+0000 ec57640 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:11:11.429153+0000 front 2024-04-09T12:09:45.660061+0000 (oldest deadline 2024-04-09T12:11:11.618005+0000) 2024-04-09T12:11:11.777 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:11.775+0000 ec57640 -1 osd.0 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:12.165 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:12.163+0000 ec57640 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:11:10.992998+0000 front 2024-04-09T12:09:46.178766+0000 (oldest deadline 2024-04-09T12:11:08.688962+0000) 2024-04-09T12:11:12.165 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:12.164+0000 ec57640 -1 osd.2 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:12.200 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:11:12.198+0000 12c5f640 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:11:11.214064+0000 front 2024-04-09T12:09:47.586917+0000 (oldest deadline 2024-04-09T12:11:09.882045+0000) 2024-04-09T12:11:12.429 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:11:12.420+0000 ec57640 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:44.449159+0000 front 2024-04-09T12:09:44.210637+0000 (oldest deadline 2024-04-09T12:11:09.633528+0000) 2024-04-09T12:11:12.440 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:12.439+0000 12c5f640 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:45.135567+0000 front 2024-04-09T12:09:45.121151+0000 (oldest deadline 2024-04-09T12:11:09.808143+0000) 2024-04-09T12:11:12.729 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:12.726+0000 ec57640 -1 osd.6 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:12.794 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:12.787+0000 ec57640 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:11:12.715999+0000 front 2024-04-09T12:09:45.660061+0000 (oldest deadline 2024-04-09T12:11:11.618005+0000) 2024-04-09T12:11:12.797 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:12.793+0000 ec57640 -1 osd.0 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:13.169 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:11:13.163+0000 12c5f640 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:11:11.214064+0000 front 2024-04-09T12:09:47.586917+0000 (oldest deadline 2024-04-09T12:11:09.882045+0000) 2024-04-09T12:11:13.173 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:13.172+0000 ec57640 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:11:12.743111+0000 front 2024-04-09T12:09:46.178766+0000 (oldest deadline 2024-04-09T12:11:08.688962+0000) 2024-04-09T12:11:13.175 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:13.174+0000 ec57640 -1 osd.2 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:13.423 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:11:13.421+0000 12c5f640 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:09:45.135567+0000 front 2024-04-09T12:09:45.121151+0000 (oldest deadline 2024-04-09T12:11:09.808143+0000) 2024-04-09T12:11:13.720 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:11:13.718+0000 ec57640 -1 osd.6 175 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21022.0:2 103.13 103.7c099dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e162) 2024-04-09T12:11:13.834 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:11:13.832+0000 ec57640 -1 osd.0 175 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21016.0:2 100.6 100:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:14.236 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:11:14.225+0000 ec57640 -1 osd.2 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20995.0:39 12.1a 12:5848ad14:::38.obj:head [write 0~171 in=171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158) 2024-04-09T12:11:15.719 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:11:15.717+0000 1045a640 -1 osd.5 176 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-09T12:11:19.154 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:07:12.784 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:19.159 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:07:12.789 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:19.197 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:07:12.826 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:19.209 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:12.838 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:19.211 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:12.841 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:19.218 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:07:12.848 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:19.220 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:07:12.850 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:19.246 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:12.876 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:19.268 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:07:12.897 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:28.159 INFO:tasks.workunit.client.0.smithi029.stdout:********* 2024-04-09T12:11:28.159 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_9_[103422]: starting. 2024-04-09T12:11:28.159 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_9_[103422]: creating pool ceph_test_rados_list_parallel.smithi029-41482 2024-04-09T12:11:28.159 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_9_[103422]: created object 0... 2024-04-09T12:11:28.159 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_9_[103422]: created object 25... 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_9_[103422]: created object 49... 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_9_[103422]: finishing. 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_9_[103422]: shutting down. 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_10_[103423]: starting. 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_10_[103423]: listing objects. 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_10_[103423]: listed object 0... 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_10_[103423]: listed object 25... 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_10_[103423]: listed object 50... 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_10_[103423]: listed object 75... 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_10_[103423]: saw 97 objects 2024-04-09T12:11:28.160 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_10_[103423]: shutting down. 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_13_[103426]: starting. 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_13_[103426]: removed 25 objects... 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_13_[103426]: removed half of the objects 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_13_[103426]: removed 50 objects... 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_13_[103426]: removed 50 objects 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_13_[103426]: shutting down. 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_11_[103424]: starting. 2024-04-09T12:11:28.161 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_11_[103424]: added 25 objects... 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_11_[103424]: added half of the objects 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_11_[103424]: added 50 objects... 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_11_[103424]: added 50 objects 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_11_[103424]: shutting down. 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_12_[103425]: starting. 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_12_[103425]: added 25 objects... 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_12_[103425]: added half of the objects 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_12_[103425]: added 50 objects... 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_12_[103425]: added 50 objects 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_12_[103425]: shutting down. 2024-04-09T12:11:28.162 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_14_[105106]: starting. 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_14_[105106]: creating pool ceph_test_rados_list_parallel.smithi029-41482 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_14_[105106]: created object 0... 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_14_[105106]: created object 25... 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_14_[105106]: created object 49... 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_14_[105106]: finishing. 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_14_[105106]: shutting down. 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.163 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.164 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.164 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:28.164 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_15_[105107]: starting. 2024-04-09T12:11:28.164 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_15_[105107]: listing objects. 2024-04-09T12:11:28.164 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_15_[105107]: listed object 0... 2024-04-09T12:11:33.696 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_15_[105107]: listed object 25... 2024-04-09T12:11:33.696 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_15_[105107]: listed object 50... 2024-04-09T12:11:33.696 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_15_[105107]: listed object 75... 2024-04-09T12:11:33.696 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_15_[105107]: listed object 100... 2024-04-09T12:11:33.696 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_15_[105107]: listed object 125... 2024-04-09T12:11:33.696 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_15_[105107]: saw 150 objects 2024-04-09T12:11:33.696 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_15_[105107]: shutting down. 2024-04-09T12:11:33.696 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:33.696 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:33.696 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:33.696 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_16_[105108]: starting. 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_16_[105108]: added 25 objects... 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_16_[105108]: added half of the objects 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_16_[105108]: added 50 objects... 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_16_[105108]: added 50 objects 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: process_16_[105108]: shutting down. 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******************************* 2024-04-09T12:11:33.697 INFO:tasks.workunit.client.0.smithi029.stdout: list_parallel: ******* SUCCESS ********** 2024-04-09T12:11:39.511 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:07:33.141 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:39.516 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:07:33.146 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:39.579 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:33.209 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:39.582 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:33.212 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:39.587 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:07:33.216 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:39.593 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:07:33.223 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:39.595 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:07:33.225 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:39.641 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:33.271 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:39.673 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:07:33.303 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:46.081 INFO:tasks.workunit.client.0.smithi029.stdout:sSnapshotsECPP.SnapRemovePP (2059 ms) 2024-04-09T12:11:46.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-04-09T12:11:46.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (86457 ms) 2024-04-09T12:11:46.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2545 ms) 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (94254 ms total) 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (6529 ms) 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (7145 ms) 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4732 ms) 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (18406 ms total) 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: 2024-04-09T12:11:46.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-04-09T12:11:46.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (316785 ms total) 2024-04-09T12:11:46.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-04-09T12:11:46.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-04-09T12:11:46.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-09T12:11:59.621 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:07:53.251 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:59.626 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:07:53.256 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:59.678 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:07:53.308 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:59.679 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:07:53.309 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:59.683 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:07:53.313 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:59.690 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:53.320 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:59.694 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:53.325 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:59.726 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:07:53.355 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:11:59.735 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:53.366 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:03.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-04-09T12:12:03.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-04-09T12:12:03.081 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (4489 ms) 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (50092 ms) 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (25580 ms) 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (12242 ms) 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (32329 ms) 2024-04-09T12:12:03.082 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-04-09T12:12:03.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (29041 ms) 2024-04-09T12:12:03.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-04-09T12:12:03.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (8821 ms) 2024-04-09T12:12:03.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-04-09T12:12:03.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (2906 ms) 2024-04-09T12:12:03.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-04-09T12:12:03.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (7617 ms) 2024-04-09T12:12:03.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-04-09T12:12:03.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (4757 ms) 2024-04-09T12:12:03.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-04-09T12:12:03.083 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2821 ms) 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (4224 ms) 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (4246 ms) 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (2963 ms) 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (4366 ms) 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3357 ms) 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-04-09T12:12:03.084 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (86257 ms) 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (4887 ms) 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (4236 ms) 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (4161 ms) 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (5143 ms) 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3353 ms) 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (4768 ms) 2024-04-09T12:12:03.085 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-04-09T12:12:03.086 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3192 ms) 2024-04-09T12:12:03.086 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-04-09T12:12:03.086 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3205 ms) 2024-04-09T12:12:03.086 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-04-09T12:12:03.086 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3594 ms) 2024-04-09T12:12:03.086 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-04-09T12:12:12.637 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:12.635+0000 12c5f640 -1 osd.4 225 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:13.685 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:13.682+0000 12c5f640 -1 osd.4 226 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:14.718 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:14.709+0000 12c5f640 -1 osd.4 228 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:15.777 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:15.773+0000 12c5f640 -1 osd.4 229 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:16.739 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:16.737+0000 12c5f640 -1 osd.4 229 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:17.846 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:17.827+0000 12c5f640 -1 osd.4 230 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:18.826 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:18.824+0000 12c5f640 -1 osd.4 231 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:19.746 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:13.376 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:19.748 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:13.378 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:19.795 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:13.425 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:19.800 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:13.430 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:19.818 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:13.448 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:19.827 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:13.457 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:19.855 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:13.485 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:19.861 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:19.859+0000 12c5f640 -1 osd.4 232 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:19.864 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:13.494 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:19.871 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:13.501 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:20.975 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:20.965+0000 12c5f640 -1 osd.4 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:22.008 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:22.006+0000 12c5f640 -1 osd.4 234 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:22.968 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:22.967+0000 12c5f640 -1 osd.4 235 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:23.799 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:17.429 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:23.802 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:17.432 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:23.822 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:17.452 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:23.858 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:17.488 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:23.859 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:17.489 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:23.864 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:17.494 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:23.875 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:17.505 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:23.889 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:17.519 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:23.903 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:17.533 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:23.934 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:23.932+0000 12c5f640 -1 osd.4 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:24.928 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:12:24.922+0000 ec57640 -1 osd.6 202 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21094.0:2 118.6 118.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e202) 2024-04-09T12:12:24.934 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:24.932+0000 12c5f640 -1 osd.4 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:25.919 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:12:25.917+0000 12c5f640 -1 osd.4 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:422 58.d 58:b0b7f99e:test-rados-api-smithi029-41041-14::foo53:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) 2024-04-09T12:12:26.165 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:12:26.162+0000 ec57640 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21094.0:2 118.6 118.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e202) 2024-04-09T12:12:27.156 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:12:27.149+0000 ec57640 -1 osd.6 214 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21094.0:2 118.6 118:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e202) 2024-04-09T12:12:28.359 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:12:28.356+0000 ec57640 -1 osd.6 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21094.0:2 118.6 118:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e202) 2024-04-09T12:12:29.532 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:12:29.501+0000 ec57640 -1 osd.6 231 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21094.0:2 118.6 118:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e202) 2024-04-09T12:12:39.679 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:33.309 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:39.683 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:33.313 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:39.734 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:33.364 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:39.737 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:33.367 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:39.753 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:33.383 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:39.758 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:33.388 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:39.764 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:33.394 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:39.775 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:33.406 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:39.796 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:33.426 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:50.366 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRad api_aio: Running main() from gmock_main.cc 2024-04-09T12:12:50.366 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-04-09T12:12:50.366 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [----------] Global test environment set-up. 2024-04-09T12:12:50.366 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-04-09T12:12:50.366 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-04-09T12:12:50.366 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.TooBig (5593 ms) 2024-04-09T12:12:50.366 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (62856 ms) 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (7154 ms) 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (6898 ms) 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (59001 ms) 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (18977 ms) 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (5008 ms) 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-04-09T12:12:50.367 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (3095 ms) 2024-04-09T12:12:50.368 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-04-09T12:12:50.368 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (4547 ms) 2024-04-09T12:12:50.368 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-04-09T12:12:50.368 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (5804 ms) 2024-04-09T12:12:50.368 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-04-09T12:12:50.368 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3855 ms) 2024-04-09T12:12:50.368 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-04-09T12:12:50.368 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (4252 ms) 2024-04-09T12:12:50.368 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (5077 ms) 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (4388 ms) 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.Flush (89614 ms) 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (4871 ms) 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (4318 ms) 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (4102 ms) 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3063 ms) 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-04-09T12:12:50.369 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3315 ms) 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (4158 ms) 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (57304 ms) 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (4566 ms) 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3113 ms) 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (2707 ms) 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3579 ms) 2024-04-09T12:12:50.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [----------] 26 tests from LibRadosAio (381217 ms total) 2024-04-09T12:12:50.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: 2024-04-09T12:12:50.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-04-09T12:12:59.866 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:53.496 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:59.873 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:53.503 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:59.874 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:53.504 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:59.932 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:53.562 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:59.939 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:53.566 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:59.942 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:53.572 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:12:59.944 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:53.575 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:00.014 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:53.644 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:00.022 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:08:53.652 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:08.097 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleW api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-04-09T12:13:08.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-04-09T12:13:08.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-04-09T12:13:08.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-04-09T12:13:08.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-04-09T12:13:08.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-09T12:13:08.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: 2024-04-09T12:13:08.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-04-09T12:13:08.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: seed 40989 2024-04-09T12:13:08.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-04-09T12:13:08.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (14 ms) 2024-04-09T12:13:08.098 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (41802 ms) 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (10914 ms) 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (20054 ms) 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (7012 ms) 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (66 ms) 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (1676 ms) 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (590 ms) 2024-04-09T12:13:08.099 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (55 ms) 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (187 ms) 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (45 ms) 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (719 ms) 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (1253 ms) 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: osd_max_attr_size = 0 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (123618 ms) 2024-04-09T12:13:08.100 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (97563 ms) 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: done waiting, doing copies 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: waiting for final deep scrubs... 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: done waiting 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (82272 ms) 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (466 ms) 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (404 ms) 2024-04-09T12:13:08.101 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-04-09T12:13:08.102 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4806 ms) 2024-04-09T12:13:08.102 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-04-09T12:13:08.102 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-04-09T12:13:08.102 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-04-09T12:13:08.102 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-04-09T12:13:08.102 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-04-09T12:13:08.102 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-04-09T12:13:20.096 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:09:13.726 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:20.100 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:09:13.730 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:20.153 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:13.784 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:20.157 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:13.787 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:20.178 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:09:13.808 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:20.179 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:09:13.809 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:20.180 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:09:13.810 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:20.214 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:13.844 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:20.246 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:09:13.876 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:39.991 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:09:33.620 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:39.994 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:09:33.625 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:40.043 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:09:33.673 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:40.045 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:09:33.675 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:40.057 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:09:33.687 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:40.091 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:09:33.721 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:40.095 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:33.725 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:40.101 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:33.731 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:40.143 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:33.773 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:13:40.995 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:40.988+0000 ec57640 -1 osd.3 307 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:42.041 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:42.039+0000 ec57640 -1 osd.3 307 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:42.999 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:42.996+0000 ec57640 -1 osd.2 308 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:43.018 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:43.014+0000 ec57640 -1 osd.3 308 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:43.970 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:43.968+0000 ec57640 -1 osd.3 309 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:43.984 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:43.982+0000 ec57640 -1 osd.2 309 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:44.961 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:44.958+0000 ec57640 -1 osd.2 309 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:44.966 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:44.965+0000 ec57640 -1 osd.3 310 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:45.939 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:45.936+0000 ec57640 -1 osd.2 311 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:45.949 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:45.947+0000 ec57640 -1 osd.3 311 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:46.965 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:46.964+0000 ec57640 -1 osd.3 312 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:47.023 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:47.016+0000 ec57640 -1 osd.2 312 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:48.015 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:48.013+0000 ec57640 -1 osd.3 313 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:48.053 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:48.050+0000 ec57640 -1 osd.2 313 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:49.040 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:49.038+0000 ec57640 -1 osd.2 314 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:49.046 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:49.042+0000 ec57640 -1 osd.3 314 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:50.063 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:50.061+0000 ec57640 -1 osd.2 314 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:50.092 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:50.088+0000 ec57640 -1 osd.3 314 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:51.118 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:51.116+0000 ec57640 -1 osd.2 315 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:51.126 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:51.123+0000 ec57640 -1 osd.3 315 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:52.096 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:52.095+0000 ec57640 -1 osd.2 316 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:52.124 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:52.123+0000 ec57640 -1 osd.3 316 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:53.109 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:53.107+0000 ec57640 -1 osd.2 317 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:53.121 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:53.119+0000 ec57640 -1 osd.3 317 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:54.100 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:54.098+0000 ec57640 -1 osd.3 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:54.163 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:54.161+0000 ec57640 -1 osd.2 317 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:55.136 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:55.134+0000 ec57640 -1 osd.3 319 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:55.245 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:55.214+0000 ec57640 -1 osd.2 320 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:56.292 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:56.289+0000 ec57640 -1 osd.3 321 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:56.334 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:56.330+0000 ec57640 -1 osd.2 321 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:57.255 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:57.253+0000 ec57640 -1 osd.3 321 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:57.360 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:57.357+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:58.210 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:58.208+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:58.374 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:58.373+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:13:59.191 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:13:59.190+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:13:59.342 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:13:59.340+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:00.046 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:09:53.676 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:00.094 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:53.724 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:00.097 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:53.728 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:00.098 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:09:53.728 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:00.138 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:53.768 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:00.143 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:09:53.773 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:00.145 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:09:53.775 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:00.149 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:09:53.780 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:00.193 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:09:53.823 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:00.221 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:00.220+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:00.351 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:00.350+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:01.195 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:01.193+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:01.353 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:01.352+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:02.212 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:02.209+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:02.390 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:02.389+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:03.202 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:03.201+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:03.437 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:03.435+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:04.188 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:04.186+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:04.410 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:04.408+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:05.144 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:05.142+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:05.394 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:05.392+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:06.135 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:06.134+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:06.415 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:06.414+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:07.177 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:07.175+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:07.453 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:07.452+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:08.208 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:08.207+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:08.453 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:08.451+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:09.228 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:09.227+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:09.500 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:09.498+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:10.261 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:10.261+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:10.544 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:10.543+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:11.290 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:11.289+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:11.506 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:11.506+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:12.305 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:12.304+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:12.545 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:12.544+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:13.273 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:13.271+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:13.528 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:13.526+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:14.313 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:14.312+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:14.561 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:14.560+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:15.269 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:15.269+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:15.587 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:15.586+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:16.322 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:16.320+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:16.553 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:16.552+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:17.297 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:17.296+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:17.520 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:17.518+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:18.340 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:18.340+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:18.539 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:18.538+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:19.389 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:19.387+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:19.587 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:19.586+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:20.103 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:13.733 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:20.157 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:13.787 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:20.191 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:13.821 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:20.202 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:13.833 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:20.204 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:13.834 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:20.219 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:13.849 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:20.221 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:13.851 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:20.227 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:13.858 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:20.243 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:13.873 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:20.390 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:20.388+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:20.575 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:20.574+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:21.431 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:21.430+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:21.569 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:21.567+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:22.441 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:22.441+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:22.615 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:22.614+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:23.438 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:23.436+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:23.607 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:23.606+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:24.405 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:24.405+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:24.566 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:24.564+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:25.415 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:25.415+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:25.563 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:25.562+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:26.392 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:26.391+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:26.544 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:26.544+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:27.363 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:27.362+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:27.588 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:27.587+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:28.385 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:28.384+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:28.592 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:28.591+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:29.385 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:29.384+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:29.568 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:29.568+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:30.427 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:30.427+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:30.493 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:14:30.491+0000 12c5f640 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:13:10.112755+0000 front 2024-04-09T12:13:10.184553+0000 (oldest deadline 2024-04-09T12:14:30.442895+0000) 2024-04-09T12:14:30.571 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:30.570+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:31.416 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:31.415+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:31.538 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:14:31.534+0000 12c5f640 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:13:10.112755+0000 front 2024-04-09T12:13:10.184553+0000 (oldest deadline 2024-04-09T12:14:30.442895+0000) 2024-04-09T12:14:31.584 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:31.583+0000 ec57640 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:13:08.038701+0000 front 2024-04-09T12:13:08.037323+0000 (oldest deadline 2024-04-09T12:14:30.927279+0000) 2024-04-09T12:14:31.584 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:31.583+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:32.046 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:14:32.038+0000 ec57640 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:13:10.147088+0000 front 2024-04-09T12:13:10.074269+0000 (oldest deadline 2024-04-09T12:14:31.077194+0000) 2024-04-09T12:14:32.160 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:14:32.159+0000 12c5f640 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:13:08.464388+0000 front 2024-04-09T12:13:08.453439+0000 (oldest deadline 2024-04-09T12:14:31.172608+0000) 2024-04-09T12:14:32.308 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:14:32.306+0000 12c5f640 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:13:05.646210+0000 front 2024-04-09T12:13:05.649280+0000 (oldest deadline 2024-04-09T12:14:31.538536+0000) 2024-04-09T12:14:32.456 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:14:32.456+0000 ec57640 -1 osd.3 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:682 58.4 58:25573dcc:test-rados-api-smithi029-41041-14::foo10:head [writefull 0~11 in=11b] snapc 6=[6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e278) 2024-04-09T12:14:32.494 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:14:32.491+0000 12c5f640 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:13:10.112755+0000 front 2024-04-09T12:13:10.184553+0000 (oldest deadline 2024-04-09T12:14:30.442895+0000) 2024-04-09T12:14:32.555 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:32.554+0000 ec57640 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.173:6830 osd.5 since back 2024-04-09T12:13:08.038701+0000 front 2024-04-09T12:13:08.037323+0000 (oldest deadline 2024-04-09T12:14:30.927279+0000) 2024-04-09T12:14:32.555 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:32.555+0000 ec57640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:33.604 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:14:33.603+0000 ec57640 -1 osd.2 323 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17219.0:1 147.6s0 147.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e280) 2024-04-09T12:14:35.318 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:28.948 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:35.382 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:29.012 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:35.424 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:29.054 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:35.433 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:29.064 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:35.435 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:29.065 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:35.465 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:29.095 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:35.467 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:29.097 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:35.473 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:29.104 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:35.510 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:29.140 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:37.969 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [-------ist: : entry=6 expected=6 2024-04-09T12:14:37.969 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:bd63b0f1:::8:head 2024-04-09T12:14:37.969 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:bd63b0f1:::8:head expected=17:bd63b0f1:::8:head 2024-04-09T12:14:37.969 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:bd63b0f1:::8:head -> 8 2024-04-09T12:14:37.969 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=8 expected=8 2024-04-09T12:14:37.969 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:b29083e3:::5:head 2024-04-09T12:14:37.969 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:b29083e3:::5:head expected=17:b29083e3:::5:head 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:b29083e3:::5:head -> 5 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=5 expected=5 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:89d3ae78:::11:head 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:89d3ae78:::11:head expected=17:89d3ae78:::11:head 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:89d3ae78:::11:head -> 11 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=11 expected=11 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:863748b0:::15:head 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:863748b0:::15:head expected=17:863748b0:::15:head 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:863748b0:::15:head -> 15 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=15 expected=15 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:6cac518f:::0:head 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:6cac518f:::0:head expected=17:6cac518f:::0:head 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:6cac518f:::0:head -> 0 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=0 expected=0 2024-04-09T12:14:37.970 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:02547ec2:::1:head 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:02547ec2:::1:head expected=17:02547ec2:::1:head 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:02547ec2:::1:head -> 1 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=1 expected=1 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:62a1935d:::14:head 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:62a1935d:::14:head expected=17:62a1935d:::14:head 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:62a1935d:::14:head -> 14 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=14 expected=14 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : seek to 17:5c6b0b28:::7:head 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : cursor()=17:5c6b0b28:::7:head expected=17:5c6b0b28:::7:head 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: > 17:5c6b0b28:::7:head -> 7 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: : entry=7 expected=7 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (13368 ms) 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (51249 ms) 2024-04-09T12:14:37.971 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: split 0/5 -> MIN 17:33333333::::head 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: split 1/5 -> 17:33333333::::head 17:66666666::::head 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: split 2/5 -> 17:66666666::::head 17:99999999::::head 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: split 3/5 -> 17:99999999::::head 17:cccccccc::::head 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: split 4/5 -> 17:cccccccc::::head MAX 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (200075 ms) 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [----------] 7 tests from LibRadosList (394793 ms total) 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (83808 ms) 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: myset foo1,foo2,foo3 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo1 2024-04-09T12:14:37.972 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo2 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo3 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: myset foo1,foo4,foo5 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo4 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo5 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo1 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: myset foo6,foo7 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo7 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: foo6 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: ns1:foo4 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: ns1:foo5 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: ns2:foo7 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: ns2:foo6 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: ns1:foo1 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: :foo1 2024-04-09T12:14:37.973 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: :foo2 2024-04-09T12:14:37.974 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: :foo3 2024-04-09T12:14:37.974 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (2132 ms) 2024-04-09T12:14:40.165 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:33.795 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:40.225 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:33.855 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:40.249 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:33.879 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:40.270 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:33.900 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:40.271 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:33.902 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:40.279 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:33.910 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:40.281 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:33.911 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:40.298 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:33.928 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:40.306 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:33.936 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:14:46.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 1 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 10 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 13 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 7 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 14 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 0 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 15 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 11 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 5 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 8 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 6 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 3 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 4 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 12 0 2024-04-09T12:14:46.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 9 0 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 2 0 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (2474 ms) 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [----------] 3 tests from LibRadosListEC (88414 ms total) 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (2864 ms) 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [----------] 1 test from LibRadosListNP (2864 ms total) 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [----------] Global test environment tear-down 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [==========] 11 tests from 3 test suites ran. (497189 ms total) 2024-04-09T12:14:46.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_list: [ PASSED ] 11 tests. 2024-04-09T12:14:56.369 INFO:tasks.workunit.client.0.smithi029.stdout:---] 22 tests from LibRadosMiscPP (393516 ms total) 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (82765 ms) 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (82766 ms total) 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (497 ms) 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (56 ms) 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (553 ms total) 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: 2024-04-09T12:14:56.370 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (673 ms) 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (181 ms) 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (854 ms total) 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (454 ms) 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (64 ms) 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (518 ms total) 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-04-09T12:14:56.371 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-04-09T12:14:56.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1520 ms) 2024-04-09T12:14:56.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1520 ms total) 2024-04-09T12:14:56.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: 2024-04-09T12:14:56.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-04-09T12:14:56.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (507092 ms total) 2024-04-09T12:14:56.372 INFO:tasks.workunit.client.0.smithi029.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-04-09T12:15:00.304 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:53.935 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:00.309 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:53.939 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:00.357 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:53.987 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:00.358 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:53.989 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:00.372 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:54.003 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:00.374 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:54.005 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:00.402 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:10:54.033 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:00.419 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:54.050 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:00.422 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:10:54.052 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:23.569 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:15:23.566+0000 1045a640 -1 osd.5 371 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-09T12:15:25.593 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:19.223 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:25.598 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:19.229 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:25.650 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:19.281 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:25.652 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:19.282 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:25.653 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:19.284 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:25.657 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:19.287 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:25.658 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:19.289 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:25.708 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:19.338 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:25.713 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:19.343 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:28.821 INFO:tasks.workunit.client.0.smithi029.stdout:rite 2024-04-09T12:15:28.821 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (8069 ms) 2024-04-09T12:15:28.821 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-04-09T12:15:28.821 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (7715 ms) 2024-04-09T12:15:28.821 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-04-09T12:15:28.821 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6904 ms) 2024-04-09T12:15:28.821 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-04-09T12:15:28.821 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7153 ms) 2024-04-09T12:15:28.821 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-04-09T12:15:28.821 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7787 ms) 2024-04-09T12:15:28.821 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (8158 ms) 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (8263 ms) 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (8005 ms) 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (43910 ms) 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7195 ms) 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7275 ms) 2024-04-09T12:15:28.822 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7621 ms) 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (8147 ms) 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7792 ms) 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (6347 ms) 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (8112 ms) 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (158454 ms total) 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [----------] Global test environment tear-down 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (539671 ms total) 2024-04-09T12:15:28.823 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio: [ PASSED ] 42 tests. 2024-04-09T12:15:45.678 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:39.308 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:45.740 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:39.371 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:45.742 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:39.372 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:45.746 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:39.377 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:45.787 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:39.417 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:45.793 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:39.423 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:45.816 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:39.446 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:45.817 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:39.448 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:45.863 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:39.493 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:55.708 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:49.338 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:55.774 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:49.405 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:55.812 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:49.442 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:55.846 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:49.476 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:55.846 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:49.477 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:55.853 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:49.483 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:55.877 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:49.508 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:55.888 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:49.519 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:15:55.910 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:49.540 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:05.654 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:59.284 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:05.658 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:59.289 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:05.682 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:59.313 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:05.706 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:59.337 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:05.708 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:59.338 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:05.708 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:59.338 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:05.709 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:59.339 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:05.729 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:59.360 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:05.733 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:11:59.364 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:07.382 INFO:tasks.workunit.client.0.smithi029.stdout:osAio.RoundTripAppendPP (11278 ms) 2024-04-09T12:16:07.382 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3235 ms) 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3439 ms) 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3399 ms) 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: setting pool EIO 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: max_success 0, min_failed 1 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (3475 ms) 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (4438 ms) 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (351913 ms total) 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-04-09T12:16:07.383 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-04-09T12:16:07.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (15334 ms) 2024-04-09T12:16:07.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-04-09T12:16:07.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (10399 ms) 2024-04-09T12:16:07.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-04-09T12:16:07.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (17199 ms) 2024-04-09T12:16:07.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-04-09T12:16:07.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (4090 ms) 2024-04-09T12:16:07.384 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (47022 ms total) 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (2900 ms) 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (2900 ms total) 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (85268 ms) 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7263 ms) 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7472 ms) 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7401 ms) 2024-04-09T12:16:07.385 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3421 ms) 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (8150 ms) 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (7510 ms) 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7535 ms) 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (12707 ms) 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7352 ms) 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6581 ms) 2024-04-09T12:16:07.386 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-04-09T12:16:07.387 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7754 ms) 2024-04-09T12:16:07.387 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-04-09T12:16:07.387 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7980 ms) 2024-04-09T12:16:15.791 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:09.422 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:15.845 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:09.476 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:15.846 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:09.476 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:15.847 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:09.477 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:15.868 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:09.498 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:15.876 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:09.507 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:15.876 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:09.507 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:15.879 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:09.510 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:15.909 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:09.540 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:25.841 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:19.471 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:25.894 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:19.524 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:25.922 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:19.553 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:25.949 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:19.580 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:25.953 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:19.584 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:25.954 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:19.584 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:25.956 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:19.587 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:25.978 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:19.608 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:25.982 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:19.612 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:30.754 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:24.384 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:30.759 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:24.389 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:30.773 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:24.404 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:30.803 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:24.434 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:30.805 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:24.436 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:30.805 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:24.436 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:30.807 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:24.438 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:30.818 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:24.449 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:30.822 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:24.453 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:34.666 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:28.296 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:34.681 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:28.311 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:34.684 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:28.315 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:34.684 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:28.315 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:34.687 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:28.318 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:34.688 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:28.319 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:34.749 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:28.379 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:34.761 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:28.391 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:34.772 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:28.403 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:45.943 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:39.573 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:45.945 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:39.575 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:45.947 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:39.578 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:45.947 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:39.578 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:45.948 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:39.579 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:45.949 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:39.579 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:45.981 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:39.611 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:46.052 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:39.682 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:46.065 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:39.696 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:50.963 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:44.593 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.026 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:44.657 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.029 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:44.660 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.035 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:44.665 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.046 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:44.676 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.058 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:44.688 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.089 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:44.719 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.090 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:44.721 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.107 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:44.738 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.791 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:45.422 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.792 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:45.423 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.801 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:45.432 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.929 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:45.560 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.930 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:45.561 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:51.940 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:45.571 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:52.040 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:45.670 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:52.041 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:45.672 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:52.060 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:45.690 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:16:55.197 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-04-09T12:16:55.197 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3336 ms) 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7114 ms) 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7646 ms) 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (6759 ms) 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (8021 ms) 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7806 ms) 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7130 ms) 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (224207 ms total) 2024-04-09T12:16:55.198 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: 2024-04-09T12:16:55.199 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-04-09T12:16:55.199 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (626042 ms total) 2024-04-09T12:16:55.199 INFO:tasks.workunit.client.0.smithi029.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-04-09T12:17:05.942 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:59.572 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:05.944 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:59.574 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:05.978 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:12:59.608 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:05.992 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:59.623 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:05.993 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:59.624 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:05.993 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:59.624 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:05.996 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:59.627 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:06.026 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:12:59.657 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:06.032 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:59.663 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:06.803 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:00.434 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:06.804 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:00.435 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:06.813 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:00.443 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:06.852 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:00.483 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:06.853 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:00.484 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:06.854 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:00.484 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:06.854 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:00.485 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:06.863 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:00.493 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:06.865 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:00.494 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:20.938 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:14.569 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:20.985 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:14.615 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:20.986 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:14.616 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:20.989 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:14.620 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:21.010 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:14.641 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:21.015 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:14.646 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:21.037 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:14.668 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:21.039 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:14.669 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:21.063 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:14.694 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:25.999 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:19.629 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:26.002 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:19.633 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:26.012 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:19.643 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:26.048 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:19.679 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:26.050 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:19.680 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:26.059 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:19.690 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:26.060 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:19.691 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:26.078 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:19.709 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:26.088 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:19.719 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:41.043 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:34.673 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:41.045 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:34.676 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:41.061 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:34.692 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:41.094 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:34.725 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:41.095 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:34.726 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:41.101 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:34.732 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:41.103 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:34.734 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:41.110 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:34.741 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:41.118 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:34.749 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:46.189 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:39.819 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:46.191 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:39.822 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:46.203 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:39.834 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:46.235 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:39.866 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:46.239 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:39.870 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:46.240 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:39.871 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:46.241 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:39.871 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:46.252 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:39.883 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:17:46.258 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:39.888 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:06.125 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:59.755 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:06.129 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:59.760 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:06.163 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:13:59.794 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:06.176 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:59.807 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:06.178 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:59.809 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:06.179 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:59.810 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:06.180 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:59.811 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:06.210 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:59.841 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:06.212 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:13:59.843 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:16.314 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:09.945 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:16.318 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:09.949 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:16.343 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:09.973 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:16.365 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:09.996 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:16.366 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:09.997 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:16.370 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:10.001 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:16.373 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:10.003 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:16.390 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:10.021 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:16.395 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:10.026 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:26.223 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:19.853 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:26.227 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:19.858 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:26.258 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:19.888 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:26.285 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:19.916 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:26.293 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:19.921 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:26.294 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:19.924 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:26.294 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:19.925 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:26.317 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:19.948 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:26.328 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:19.959 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:31.330 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:24.961 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:31.332 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:24.963 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:31.348 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:24.979 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:31.378 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:25.009 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:31.379 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:25.010 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:31.379 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:25.010 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:31.383 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:25.013 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:31.393 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:25.024 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:31.398 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:25.029 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:46.249 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:39.880 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:46.299 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:39.930 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:46.325 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:39.956 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:46.346 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:39.977 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:46.347 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:39.978 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:46.349 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:39.980 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:46.350 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:39.981 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:46.375 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:40.005 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:46.375 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:40.006 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:47.283 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:40.914 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:47.284 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:40.915 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:47.293 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:40.924 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:47.329 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:40.960 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:47.330 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:40.961 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:47.343 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:40.974 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:47.365 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:40.996 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:47.366 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:40.997 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:47.376 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:41.006 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:18:52.551 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-04-09T12:18:52.551 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-04-09T12:18:52.551 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-04-09T12:18:52.551 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: seed 41041 2024-04-09T12:18:52.551 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-04-09T12:18:52.551 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (13339 ms) 2024-04-09T12:18:52.551 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-04-09T12:18:52.551 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (44293 ms) 2024-04-09T12:18:52.551 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-04-09T12:18:52.551 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (13128 ms) 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (70760 ms total) 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (75943 ms) 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (26896 ms) 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (114616 ms) 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: my_snaps [4] 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: my_snaps [5,4] 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: my_snaps [6,5,4] 2024-04-09T12:18:52.552 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: my_snaps [7,6,5,4] 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: promoting some heads 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: promoting from clones for snap 7 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: promoting from clones for snap 6 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: promoting from clones for snap 5 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: promoting from clones for snap 4 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: waiting for scrubs... 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: done waiting 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (269444 ms) 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (12220 ms) 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (10717 ms) 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-04-09T12:18:52.553 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (10012 ms) 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8662 ms) 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10241 ms) 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (9428 ms) 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (11271 ms) 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (41023 ms) 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (10187 ms) 2024-04-09T12:18:52.554 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-04-09T12:18:52.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (11212 ms) 2024-04-09T12:18:52.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-04-09T12:18:52.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (16049 ms) 2024-04-09T12:18:52.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-04-09T12:18:52.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (16374 ms) 2024-04-09T12:18:52.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-04-09T12:18:52.555 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (11254 ms) 2024-04-09T12:19:01.364 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:54.994 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:01.366 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:54.997 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:01.398 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:14:55.028 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:01.409 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:55.040 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:01.412 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:55.043 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:01.427 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:55.058 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:01.428 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:55.059 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:01.441 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:55.073 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:01.459 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:14:55.089 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:06.379 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:00.010 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:06.381 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:00.012 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:06.391 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:00.022 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:06.427 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:00.058 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:06.429 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:00.059 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:06.430 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:00.061 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:06.432 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:00.063 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:06.440 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:00.071 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:06.441 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:00.072 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:21.416 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:15.047 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:21.418 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:15.049 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:21.433 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:15.064 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:21.472 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:15.103 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:21.472 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:15.103 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:21.473 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:15.104 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:21.478 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:15.109 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:21.487 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:15.118 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:21.492 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:15.123 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:26.451 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:20.082 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:26.453 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:20.084 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:26.465 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:20.096 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:26.497 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:20.129 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:26.499 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:20.130 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:26.500 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:20.131 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:26.504 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:20.135 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:26.510 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:20.141 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:26.516 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:20.147 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:41.426 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:35.057 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:41.474 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:35.105 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:41.477 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:35.108 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:41.477 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:35.108 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:41.491 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:35.122 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:41.492 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:35.123 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:41.527 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:35.158 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:41.529 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:35.160 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:41.543 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:35.174 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:46.445 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:40.075 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:46.489 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:40.120 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:46.490 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:40.121 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:46.497 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:40.128 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:46.498 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:40.129 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:46.500 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:40.131 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:46.501 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:40.133 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:46.513 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:40.143 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:19:46.516 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:40.147 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:01.531 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:55.161 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:01.534 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:55.165 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:01.556 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:55.187 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:01.579 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:55.210 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:01.579 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:55.210 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:01.580 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:55.211 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:01.583 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:55.214 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:01.600 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:55.231 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:01.605 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:15:55.236 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:06.658 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:00.288 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:06.659 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:00.290 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:06.678 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:00.309 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:06.717 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:00.348 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:06.720 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:00.351 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:06.731 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:00.362 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:06.735 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:00.366 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:06.736 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:00.367 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:06.752 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:00.383 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:10.134 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-04-09T12:20:10.134 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: hmm, no HitSet yet 2024-04-09T12:20:10.134 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: ok, hit_set contains 201:602f83fe:::foo:head 2024-04-09T12:20:10.134 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (65254 ms) 2024-04-09T12:20:10.134 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg_num = 32 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 0 ls 1712665205,0 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 1 ls 1712665205,0 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 2 ls 1712665205,0 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 3 ls 1712665205,0 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 4 ls 1712665205,0 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 5 ls 1712665205,0 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 6 ls 1712665205,0 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 7 ls 1712665205,0 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 8 ls 1712665205,0 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 9 ls 1712665205,0 2024-04-09T12:20:10.135 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 10 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 11 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 12 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 13 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 14 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 15 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 16 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 17 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 18 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 19 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 20 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 21 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 22 ls 1712665205,0 2024-04-09T12:20:10.136 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 23 ls 1712665205,0 2024-04-09T12:20:10.137 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 24 ls 1712665205,0 2024-04-09T12:20:10.137 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 25 ls 1712665205,0 2024-04-09T12:20:10.137 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 26 ls 1712665205,0 2024-04-09T12:20:10.137 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 27 ls 1712665205,0 2024-04-09T12:20:10.137 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 28 ls 1712665205,0 2024-04-09T12:20:10.137 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 29 ls 1712665205,0 2024-04-09T12:20:10.137 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 30 ls 1712665205,0 2024-04-09T12:20:10.137 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg 31 ls 1712665205,0 2024-04-09T12:20:10.137 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: pg_num = 32 2024-04-09T12:20:10.137 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:6cac518f:::0:head 2024-04-09T12:20:10.137 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:02547ec2:::1:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:f905c69b:::2:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:cfc208b3:::3:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:d83876eb:::4:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:b29083e3:::5:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:c4fdafeb:::6:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:5c6b0b28:::7:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:bd63b0f1:::8:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:e960b815:::9:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:52ea6a34:::10:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:89d3ae78:::11:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:de5d7c5f:::12:head 2024-04-09T12:20:10.138 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:566253c9:::13:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:62a1935d:::14:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:863748b0:::15:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:3958e169:::16:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:4d4dabf9:::17:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:8391935d:::18:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:28883081:::19:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:69259c59:::20:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:4bdb80b7:::21:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:a11c5d71:::22:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:271af37b:::23:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:95b121be:::24:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:58d1031b:::25:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:0a050783:::26:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:c709704c:::27:head 2024-04-09T12:20:10.139 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:cbe56eaf:::28:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:86b4b162:::29:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:70d89383:::30:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:dd450c7c:::31:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:6d5729b1:::32:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:c388f3fb:::33:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:56cfea31:::34:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:9dbc1bf7:::35:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:40b74ccd:::36:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:4d5aaf42:::37:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:920f362c:::38:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:6cc53222:::39:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:9cad833f:::40:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:1ea84d41:::41:head 2024-04-09T12:20:10.140 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:c4480ef6:::42:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:a694361e:::43:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:d1bd33e9:::44:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:ddc2cd5d:::45:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:2b782207:::46:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:7b187fca:::47:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:90ecdf6f:::48:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:a5ed95fe:::49:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:ea0eaa55:::50:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:f33ef17b:::51:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:a0d1b2f6:::52:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:60c5229e:::53:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:edcbc575:::54:head 2024-04-09T12:20:10.141 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:102cf253:::55:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:efb7fb0b:::56:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:50d0a326:::57:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:d4dc5daf:::58:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:3a130462:::59:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:ec87ed71:::60:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:d5bc9454:::61:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:3ddfe313:::62:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:7c2816b9:::63:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:47e00e4d:::64:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:c6410c18:::65:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:b48ed237:::66:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:cd63ad31:::67:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:b179e92b:::68:head 2024-04-09T12:20:10.142 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:0d9f741a:::69:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:6d3352ae:::70:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:c6d5c19e:::71:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:bc4729c3:::72:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:77e930b9:::73:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:0abeecfd:::74:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:b7c37e15:::75:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:b6378398:::76:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:02bd68de:::77:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:cc795d2d:::78:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:630d4fea:::79:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:e0d29ef5:::80:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:fd6f13d2:::81:head 2024-04-09T12:20:10.143 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:606461d5:::82:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:eadbdc43:::83:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:8761d0bb:::84:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:9ef0186f:::85:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:e0d41294:::86:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:961de695:::87:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:1423148f:::88:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:633a8fa2:::89:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:a8653809:::90:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:3dac8b33:::91:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:35aad435:::92:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:f6dcc343:::93:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:dbbdad87:::94:head 2024-04-09T12:20:10.144 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:1cb48ce0:::95:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:03cd461c:::96:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:17a4ea99:::97:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:9993c9a7:::98:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:6394211c:::99:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:94c7ae57:::100:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:6fdee5bb:::101:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:9a477fd1:::102:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:eb850916:::103:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:affc56b9:::104:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:b42dc814:::105:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:f319f8f0:::106:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:9a40b9de:::107:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:8b524f28:::108:head 2024-04-09T12:20:10.145 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:e3de589f:::109:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:90f90a5b:::110:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:a7b4f1d7:::111:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:af51766e:::112:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:b6f90bd1:::113:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:e0261208:::114:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:c9569ef7:::115:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:61bebe50:::116:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:fe93412b:::117:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:d3d38bee:::118:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:3100ba0c:::119:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:d0560ada:::120:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:f0ea8b35:::121:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:766f231a:::122:head 2024-04-09T12:20:10.146 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:a07a2582:::123:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:bd7c6b3a:::124:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:fb2ddaff:::125:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:4408e1fe:::126:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:ee1df7a7:::127:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:c3002909:::128:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:4f48ffa9:::129:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:edf38733:::130:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:c08425c0:::131:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:5f902d98:::132:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:41ea2c93:::133:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:813cee13:::134:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:0131818d:::135:head 2024-04-09T12:20:10.147 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:26ba5a85:::136:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:381b8a5a:::137:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:28797e47:::138:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:bfca7f22:::139:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:36807075:::140:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:80b03975:::141:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:5c15709b:::142:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:f39ea15e:::143:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:ea992956:::144:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:48887b1c:::145:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:9f24a9dd:::146:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:987f100b:::147:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:d2dd3581:::148:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:7fed1808:::149:head 2024-04-09T12:20:10.148 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:c80b70e9:::150:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:85ed90f9:::151:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:36428b24:::152:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:d044c34a:::153:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:7c18bf58:::154:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:d1c21232:::155:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:a7a3c575:::156:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:87da0633:::157:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:d5ac3822:::158:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:3f20522d:::159:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:6ca26563:::160:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:532ce135:::161:head 2024-04-09T12:20:10.149 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking for 202:c78863e6:::162:head 2024-04-09T12:20:21.626 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:15.256 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:21.627 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:15.258 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:21.645 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:15.276 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:21.670 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:15.301 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:21.672 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:15.303 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:21.679 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:15.310 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:21.680 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:15.311 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:21.692 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:15.324 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:21.708 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:15.338 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:26.632 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:20.263 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:26.638 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:20.269 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:26.665 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:20.296 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:26.687 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:20.319 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:26.691 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:20.322 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:26.701 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:20.332 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:26.704 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:20.335 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:26.706 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:20.337 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:26.720 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:20.351 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:36.730 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:30.361 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:36.732 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:30.363 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:36.748 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:30.379 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:36.777 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:30.408 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:36.780 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:30.411 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:36.784 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:30.415 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:36.786 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:30.417 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:36.796 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:30.427 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:36.804 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:30.435 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:46.757 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:40.388 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:46.761 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:40.392 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:46.778 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:40.409 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:46.808 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:40.439 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:46.809 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:40.441 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:46.811 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:40.443 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:46.812 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:40.443 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:46.832 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:40.463 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:46.837 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:40.469 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:51.730 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:45.361 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:51.776 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:45.407 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:51.777 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:45.408 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:51.782 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:45.413 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:51.784 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:45.415 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:51.785 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:45.416 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:51.793 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:45.425 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:51.796 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:16:45.427 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:20:51.802 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:16:45.433 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:06.816 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:00.446 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:06.817 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:00.448 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:06.831 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:00.462 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:06.863 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:00.494 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:06.864 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:00.496 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:06.865 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:00.497 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:06.867 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:00.498 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:06.878 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:00.510 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:06.882 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:00.513 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:11.829 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:05.460 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:11.831 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:05.463 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:11.832 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:05.464 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:11.833 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:05.464 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:11.845 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:05.476 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:11.849 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:05.480 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:11.885 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:05.516 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:11.888 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:05.519 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:11.898 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:05.529 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:26.813 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:20.443 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:26.860 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:20.492 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:26.861 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:20.492 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:26.861 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:20.493 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:26.877 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:20.507 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:26.877 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:20.509 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:26.912 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:20.543 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:26.913 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:20.544 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:26.928 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:20.559 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:31.879 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:25.510 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:31.883 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:25.514 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:31.893 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:25.524 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:31.933 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:25.564 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:31.934 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:25.565 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:31.944 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:25.575 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:31.945 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:25.576 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:31.947 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:25.578 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:31.959 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:25.591 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:46.911 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:40.542 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:46.913 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:40.545 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:46.928 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:40.559 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:46.960 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:40.591 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:46.963 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:40.594 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:46.964 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:40.595 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:46.965 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:40.596 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:46.977 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:40.608 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:46.979 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:40.610 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:51.931 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:45.562 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:51.934 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:45.565 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:51.944 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:45.575 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:51.984 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:45.615 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:51.985 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:45.617 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:51.987 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:45.618 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:51.991 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:45.623 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:51.996 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:45.627 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:52.001 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:45.632 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:53.165 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:46.796 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:53.170 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:46.802 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:53.184 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:46.815 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:53.224 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:46.855 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:53.225 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:46.856 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:53.226 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:46.857 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:53.227 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:46.858 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:53.238 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:46.869 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:21:53.241 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:17:46.872 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:05.098 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:22:05.096+0000 ec57640 -1 osd.3 566 heartbeat_check: no reply from 172.21.15.173:6822 osd.4 since back 2024-04-09T12:20:42.801211+0000 front 2024-04-09T12:20:42.796939+0000 (oldest deadline 2024-04-09T12:22:05.092279+0000) 2024-04-09T12:22:05.260 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:22:05.259+0000 ec57640 -1 osd.2 566 heartbeat_check: no reply from 172.21.15.173:6822 osd.4 since back 2024-04-09T12:20:39.791979+0000 front 2024-04-09T12:20:39.784583+0000 (oldest deadline 2024-04-09T12:22:05.080900+0000) 2024-04-09T12:22:05.537 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:22:05.529+0000 ec57640 -1 osd.5 566 heartbeat_check: no reply from 172.21.15.173:6822 osd.4 since back 2024-04-09T12:20:38.813712+0000 front 2024-04-09T12:20:38.817556+0000 (oldest deadline 2024-04-09T12:22:04.703550+0000) 2024-04-09T12:22:06.147 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:22:06.145+0000 ec57640 -1 osd.3 566 heartbeat_check: no reply from 172.21.15.173:6822 osd.4 since back 2024-04-09T12:20:42.801211+0000 front 2024-04-09T12:20:42.796939+0000 (oldest deadline 2024-04-09T12:22:05.092279+0000) 2024-04-09T12:22:06.173 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:22:06.172+0000 ec57640 -1 osd.0 566 heartbeat_check: no reply from 172.21.15.173:6822 osd.4 since back 2024-04-09T12:20:41.047018+0000 front 2024-04-09T12:20:41.045110+0000 (oldest deadline 2024-04-09T12:22:05.736904+0000) 2024-04-09T12:22:06.281 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:22:06.280+0000 ec57640 -1 osd.2 566 heartbeat_check: no reply from 172.21.15.173:6822 osd.4 since back 2024-04-09T12:20:39.791979+0000 front 2024-04-09T12:20:39.784583+0000 (oldest deadline 2024-04-09T12:22:05.080900+0000) 2024-04-09T12:22:06.525 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:22:06.525+0000 ec57640 -1 osd.5 566 heartbeat_check: no reply from 172.21.15.173:6822 osd.4 since back 2024-04-09T12:20:38.813712+0000 front 2024-04-09T12:20:38.817556+0000 (oldest deadline 2024-04-09T12:22:04.703550+0000) 2024-04-09T12:22:06.808 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:22:06.806+0000 12c5f640 -1 osd.1 566 heartbeat_check: no reply from 172.21.15.173:6822 osd.4 since back 2024-04-09T12:20:40.877664+0000 front 2024-04-09T12:20:40.878300+0000 (oldest deadline 2024-04-09T12:22:06.171751+0000) 2024-04-09T12:22:07.080 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:00.710 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:07.088 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:00.719 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:07.102 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:00.733 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:07.104 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:00.735 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:07.106 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:00.737 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:07.109 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:22:07.107+0000 ec57640 -1 osd.3 566 heartbeat_check: no reply from 172.21.15.173:6822 osd.4 since back 2024-04-09T12:20:42.801211+0000 front 2024-04-09T12:20:42.796939+0000 (oldest deadline 2024-04-09T12:22:05.092279+0000) 2024-04-09T12:22:07.125 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:00.756 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:07.156 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:00.786 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:07.156 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:22:07.155+0000 ec57640 -1 osd.0 566 heartbeat_check: no reply from 172.21.15.173:6822 osd.4 since back 2024-04-09T12:20:41.047018+0000 front 2024-04-09T12:20:41.045110+0000 (oldest deadline 2024-04-09T12:22:05.736904+0000) 2024-04-09T12:22:07.162 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:00.793 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:07.186 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:00.818 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:12.159 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:05.790 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:12.162 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:05.793 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:12.176 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:05.807 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:12.210 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:05.841 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:12.211 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:05.843 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:12.212 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:05.844 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:12.214 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:05.846 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:12.227 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:05.859 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:12.237 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:05.869 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:27.054 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:20.685 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:27.057 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:20.689 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:27.087 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:20.718 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:27.107 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:20.738 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:27.110 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:20.742 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:27.123 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:20.755 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:27.124 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:20.756 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:27.139 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:20.770 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:27.152 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:20.783 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:30.106 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:22:30.106+0000 14462640 -1 osd.4 586 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-09T12:22:32.081 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:25.712 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:32.083 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:25.714 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:32.116 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:25.747 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:32.129 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:25.760 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:32.130 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:25.762 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:32.142 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:25.773 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:32.143 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:25.775 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:32.144 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:25.776 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:32.163 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:25.794 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:42.104 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:35.735 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:42.107 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:35.738 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:42.150 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:35.781 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:42.152 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:35.783 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:42.154 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:35.785 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:42.168 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:35.799 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:42.169 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:35.800 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:42.169 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:35.800 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:42.183 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:35.814 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:57.137 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:50.768 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:57.139 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:50.770 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:57.153 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:50.784 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:57.187 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:50.818 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:57.188 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:50.820 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:57.189 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:50.820 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:57.190 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:50.821 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:57.202 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:50.834 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:57.210 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:50.841 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:22:58.015 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:22:58.016+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:22:58.977 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:22:58.977+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:00.009 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:00.009+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:01.042 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:01.042+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:01.995 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:01.995+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:01.999 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:01.999+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:02.151 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:55.783 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:02.169 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:55.800 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:02.179 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:18:55.810 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:02.199 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:55.831 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:02.201 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:55.832 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:02.210 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:55.842 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:02.218 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:55.849 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:02.219 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:55.851 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:02.230 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:18:55.861 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:02.962 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:02.961+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:02.994 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:02.994+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:03.992 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:03.992+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:04.016 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:04.016+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:04.985 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:04.985+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:05.045 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:05.045+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:06.027 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:06.028+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:06.036 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:06.036+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:07.015 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:07.015+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:07.054 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:07.053+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:08.039 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:08.039+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:08.079 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:08.079+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:09.030 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:09.030+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:09.104 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:09.103+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:10.035 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:10.035+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:10.127 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:10.126+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:11.024 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:11.024+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:11.102 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:11.102+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:12.004 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:12.003+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:12.147 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:12.146+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:13.014 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:13.014+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:13.144 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:13.143+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:14.000 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:13.999+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:14.119 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:14.118+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:14.977 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:14.978+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:15.153 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:15.152+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:16.020 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:16.020+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:16.151 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:16.150+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:17.058 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:17.057+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:17.108 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:17.108+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:17.206 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:10.837 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.211 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:10.843 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.231 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:10.862 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.261 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:10.892 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.262 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:10.892 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.263 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:10.895 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.265 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:10.896 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.281 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:10.913 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.284 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:10.915 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.942 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:11.573 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.943 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:11.574 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.944 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:11.576 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.950 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:11.582 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.963 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:11.594 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.966 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:11.597 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.967 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:11.598 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.971 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:11.603 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:17.976 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:11.607 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:18.021 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:18.021+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:18.094 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:18.094+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:19.012 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:19.012+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:19.057 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:19.056+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:20.041 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:20.042+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:20.106 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:20.105+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:21.028 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:21.029+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:21.140 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:21.140+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:22.030 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:22.031+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:22.130 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:22.129+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:23.031 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:23.032+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:23.090 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:23.089+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:24.001 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:24.002+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:24.122 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:24.121+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:25.028 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:25.029+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:25.089 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:25.088+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:26.056 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:26.056+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:26.126 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:26.125+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:27.060 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:27.060+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:27.167 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:27.167+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:28.044 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:28.044+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:28.190 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:28.190+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:29.055 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:29.054+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:29.188 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:29.188+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:30.037 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:30.036+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:30.215 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:30.214+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:31.033 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:31.033+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:31.183 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:31.183+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:32.002 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:31.999+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:32.182 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:32.182+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:32.249 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:25.880 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:32.251 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:25.882 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:32.268 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:25.899 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:32.296 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:25.928 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:32.299 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:25.931 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:32.301 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:25.932 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:32.302 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:25.934 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:32.316 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:25.947 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:32.319 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:25.951 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:33.029 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:33.029+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:33.219 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:33.218+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:34.059 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:34.058+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:34.231 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:34.230+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:35.103 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:35.102+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:35.271 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:35.270+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:36.069 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:36.068+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:36.301 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:36.300+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:37.058 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:37.057+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:37.298 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:37.297+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:38.093 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:38.092+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:38.302 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:38.301+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:39.099 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:39.099+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:39.285 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:39.285+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:40.139 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:40.138+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:40.247 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:40.247+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:41.135 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:41.134+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:41.199 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:41.199+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:42.086 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:42.085+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:42.213 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:42.213+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:42.278 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:35.909 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:42.280 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:35.911 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:42.295 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:35.927 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:42.328 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:35.960 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:42.329 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:35.960 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:42.330 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:35.961 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:42.330 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:35.961 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:42.343 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:35.975 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:42.344 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:35.976 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:43.046 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:43.046+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:43.227 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:43.227+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:44.021 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:44.021+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:44.276 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:44.275+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:45.029 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:45.029+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:45.250 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:45.250+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:45.355 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:23:45.354+0000 ec57640 -1 osd.5 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:19.963566+0000 front 2024-04-09T12:22:19.850875+0000 (oldest deadline 2024-04-09T12:23:45.131866+0000) 2024-04-09T12:23:46.021 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:46.021+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:46.226 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:46.226+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:46.347 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:23:46.346+0000 ec57640 -1 osd.5 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:19.963566+0000 front 2024-04-09T12:22:19.850875+0000 (oldest deadline 2024-04-09T12:23:45.131866+0000) 2024-04-09T12:23:46.380 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:23:46.380+0000 ec57640 -1 osd.2 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:22.435973+0000 front 2024-04-09T12:22:22.441709+0000 (oldest deadline 2024-04-09T12:23:45.929719+0000) 2024-04-09T12:23:47.009 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:47.009+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:47.178 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:47.177+0000 12c5f640 -1 osd.1 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:22.743934+0000 front 2024-04-09T12:22:22.740054+0000 (oldest deadline 2024-04-09T12:23:46.233219+0000) 2024-04-09T12:23:47.181 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:47.181+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:47.296 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:40.928 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:47.301 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:40.932 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:47.316 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:40.948 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:47.348 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:40.980 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:47.350 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:40.982 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:47.360 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:40.991 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:47.377 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:23:47.376+0000 ec57640 -1 osd.5 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:19.963566+0000 front 2024-04-09T12:22:19.850875+0000 (oldest deadline 2024-04-09T12:23:45.131866+0000) 2024-04-09T12:23:47.378 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:41.010 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:47.380 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:41.011 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:47.383 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:23:47.383+0000 ec57640 -1 osd.0 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:23.922931+0000 front 2024-04-09T12:22:23.928677+0000 (oldest deadline 2024-04-09T12:23:46.813774+0000) 2024-04-09T12:23:47.394 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:41.025 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:23:47.408 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:23:47.408+0000 ec57640 -1 osd.2 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:22.435973+0000 front 2024-04-09T12:22:22.441709+0000 (oldest deadline 2024-04-09T12:23:45.929719+0000) 2024-04-09T12:23:48.035 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:23:48.034+0000 12c5f640 -1 osd.4 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.21:36 58.9 58.d0b33ce9 (undecoded) ondisk+retry+read+ignore_cache+ignore_overlay+known_if_redirected+supports_pool_eio e587) 2024-04-09T12:23:48.178 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:48.171+0000 12c5f640 -1 osd.1 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:22.743934+0000 front 2024-04-09T12:22:22.740054+0000 (oldest deadline 2024-04-09T12:23:46.233219+0000) 2024-04-09T12:23:48.185 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:48.181+0000 12c5f640 -1 osd.1 590 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:48.371 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:23:48.372+0000 ec57640 -1 osd.0 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:23.922931+0000 front 2024-04-09T12:22:23.928677+0000 (oldest deadline 2024-04-09T12:23:46.813774+0000) 2024-04-09T12:23:48.427 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:23:48.426+0000 ec57640 -1 osd.5 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:19.963566+0000 front 2024-04-09T12:22:19.850875+0000 (oldest deadline 2024-04-09T12:23:45.131866+0000) 2024-04-09T12:23:48.448 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:23:48.448+0000 ec57640 -1 osd.2 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:22.435973+0000 front 2024-04-09T12:22:22.441709+0000 (oldest deadline 2024-04-09T12:23:45.929719+0000) 2024-04-09T12:23:48.620 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:23:48.620+0000 12c5f640 -1 osd.7 590 heartbeat_check: no reply from 172.21.15.173:6806 osd.6 since back 2024-04-09T12:22:23.250774+0000 front 2024-04-09T12:22:23.288586+0000 (oldest deadline 2024-04-09T12:23:48.501103+0000) 2024-04-09T12:23:49.136 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:49.136+0000 12c5f640 -1 osd.1 591 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:50.138 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:50.136+0000 12c5f640 -1 osd.1 592 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:51.096 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:51.096+0000 12c5f640 -1 osd.1 592 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:52.105 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:52.104+0000 12c5f640 -1 osd.1 593 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:53.120 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:53.120+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:54.116 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:54.116+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:55.111 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:55.111+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:56.097 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:56.097+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:57.078 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:57.078+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:58.115 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:58.115+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:23:59.159 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:23:59.159+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:00.187 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:00.187+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:01.184 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:01.184+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:02.235 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:02.235+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:02.348 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:55.979 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:02.353 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:55.984 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:02.388 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:56.019 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:02.400 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:56.031 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:02.406 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:56.038 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:02.417 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:56.049 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:02.420 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:56.052 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:02.428 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:56.059 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:02.443 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:56.074 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:03.158 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:56.789 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:03.159 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:56.790 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:03.167 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:56.799 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:03.199 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:56.831 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:03.200 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:56.832 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:03.209 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:19:56.840 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:03.221 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:56.853 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:03.223 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:56.854 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:03.231 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:56.862 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:03.284 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:03.284+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:04.274 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:04.274+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:05.263 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:05.264+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:06.291 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:06.291+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:07.314 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:07.315+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:08.300 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:08.300+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:09.304 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:09.302+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:10.345 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:10.344+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:11.297 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:11.297+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:12.321 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:12.321+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:12.374 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:06.005 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:12.376 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:06.007 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:12.389 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:06.020 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:12.423 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:06.054 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:12.425 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:06.057 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:12.426 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:06.057 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:12.427 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:06.058 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:12.439 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:06.070 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:12.442 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:06.074 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:13.335 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:13.333+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:14.367 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:14.365+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:15.406 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:15.406+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:16.412 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:16.412+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:17.369 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:17.368+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:18.331 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:18.330+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:19.303 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:19.302+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:20.259 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:20.258+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:21.230 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:21.230+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:22.279 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:22.277+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:22.530 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:16.161 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:22.533 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:16.164 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:22.547 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:16.178 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:22.577 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:16.209 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:22.579 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:16.210 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:22.584 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:16.215 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:22.585 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:16.216 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:22.593 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:16.224 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:22.599 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:16.230 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:23.287 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:23.286+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:24.323 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:24.322+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:25.276 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:25.275+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:26.312 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:26.311+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:27.309 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:27.308+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:27.488 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:21.119 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:27.520 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:21.151 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:27.531 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:21.163 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:27.539 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:21.171 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:27.546 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:21.177 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:27.564 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:21.195 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:27.568 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:21.199 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:27.575 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:21.206 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:27.579 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:21.210 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:28.316 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:28.314+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:29.338 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:29.337+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:30.329 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:30.328+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:31.350 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:31.350+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:32.352 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:32.351+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:33.331 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:33.330+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:34.357 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:34.355+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:35.343 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:35.342+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:36.330 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:36.329+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:36.359 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:29.990 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:36.363 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:29.994 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:36.383 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:30.014 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:36.415 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:30.046 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:36.417 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:30.049 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:36.419 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:30.050 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:36.420 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:30.052 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:36.436 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:30.067 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:36.450 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:30.081 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:37.376 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:37.375+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:37.562 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:31.193 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:37.566 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:31.198 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:37.576 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:31.207 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:37.615 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:31.247 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:37.617 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:31.249 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:37.626 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:31.257 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:37.635 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:31.266 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:37.636 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:31.268 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:37.646 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:31.278 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:38.409 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:38.408+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:39.421 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:39.420+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:40.415 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:40.415+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:41.370 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:41.370+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:42.390 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:42.389+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:42.550 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:36.181 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:42.552 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:36.183 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:42.565 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:36.194 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:42.600 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:36.232 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:42.602 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:36.233 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:42.602 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:36.233 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:42.603 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:36.234 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:42.611 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:36.243 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:42.615 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:36.246 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:43.364 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:43.364+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:44.329 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:44.329+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:45.361 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:45.361+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:46.354 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:46.354+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:47.361 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:47.362+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:48.360 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:48.360+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:49.409 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:49.410+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:50.411 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:50.411+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:51.434 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:51.435+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:52.409 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:52.410+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:52.571 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:46.202 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:52.575 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:46.206 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:52.589 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:46.220 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:52.620 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:46.251 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:52.621 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:46.252 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:52.623 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:46.255 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:52.625 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:46.256 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:52.633 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:46.265 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:52.638 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:46.269 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:24:53.441 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:53.442+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:54.470 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:54.470+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:55.508 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:55.508+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:56.545 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:56.545+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:57.583 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:57.584+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:58.601 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:58.601+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:24:59.560 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:24:59.560+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:00.518 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:00.518+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:01.495 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:01.495+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:02.524 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:02.524+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:02.613 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:56.245 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:02.618 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:56.249 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:02.633 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:20:56.264 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:02.660 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:56.292 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:02.661 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:56.293 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:02.667 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:56.298 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:02.668 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:56.300 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:02.675 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:56.307 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:02.682 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:20:56.313 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:03.569 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:03.569+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:04.536 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:04.536+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:05.492 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:05.493+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:06.507 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:06.507+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:07.554 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:07.555+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:07.627 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:01.258 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:07.631 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:01.262 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:07.642 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:01.273 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:07.676 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:01.308 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:07.677 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:01.309 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:07.678 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:01.310 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:07.679 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:01.311 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:07.688 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:01.320 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:07.690 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:01.322 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:08.599 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:08.599+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:09.556 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:09.557+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:10.573 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:10.573+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:11.550 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:11.551+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:12.564 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:12.565+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:13.602 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:13.601+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:14.656 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:14.655+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:15.664 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:15.663+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:16.698 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:16.697+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:17.676 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:17.676+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:18.665 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:18.663+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:19.663 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:19.663+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:20.669 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:20.668+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:21.686 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:21.685+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:22.680 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:16.311 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:22.683 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:16.315 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:22.709 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:16.341 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:22.711 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:22.711+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:22.730 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:16.362 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:22.733 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:16.365 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:22.740 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:16.371 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:22.746 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:16.377 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:22.750 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:16.382 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:22.765 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:16.396 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:23.486 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:17.117 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:23.487 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:17.118 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:23.495 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:17.127 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:23.560 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:17.191 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:23.561 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:17.193 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:23.566 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:17.197 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:23.567 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:17.199 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:23.572 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:17.204 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:23.579 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:17.210 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:23.736 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:23.735+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:24.709 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:24.708+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:25.730 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:25.729+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:26.700 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:26.700+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:27.667 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:27.666+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:28.702 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:28.702+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:29.673 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:29.673+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:30.646 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:30.645+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:31.657 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:31.657+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:32.704 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:32.703+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:33.746 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:33.745+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:34.734 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:34.733+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:35.719 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:35.719+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:36.747 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:36.746+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:37.720 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:31.351 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:37.723 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:31.355 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:37.740 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:31.372 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:37.773 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:31.405 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:37.774 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:31.406 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:37.776 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:31.408 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:37.778 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:31.409 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:37.790 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:31.422 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:37.794 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:31.426 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:37.796 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:37.795+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:38.835 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:38.834+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:39.842 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:39.841+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:40.804 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:40.802+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:41.821 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:41.821+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:42.732 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:36.364 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:42.735 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:36.366 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:42.751 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:36.382 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:42.781 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:36.413 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:42.782 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:36.414 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:42.792 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:36.424 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:42.805 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:36.437 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:42.806 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:36.438 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:42.807 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:42.806+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:42.817 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:36.449 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:43.829 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:43.829+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:44.862 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:44.861+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:45.894 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:45.894+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:46.876 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:46.875+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:47.790 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:41.421 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:47.794 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:41.425 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:47.805 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:41.437 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:47.838 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:41.470 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:47.839 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:41.471 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:47.841 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:41.472 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:47.842 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:41.473 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:47.851 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:41.483 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:47.852 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:41.484 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:25:47.871 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:47.871+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:48.893 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:48.894+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:49.864 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:49.865+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:50.889 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:50.888+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:51.849 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:51.850+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:52.841 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:52.841+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:53.817 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:53.818+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:54.830 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:54.830+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:55.874 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:55.875+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:56.911 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:56.911+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:57.872 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:57.873+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:58.834 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:58.835+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:25:59.849 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:25:59.849+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:00.901 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:00.901+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:01.945 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:01.945+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:02.834 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:56.465 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:02.840 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:56.472 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:02.862 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:56.493 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:02.889 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:56.520 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:02.890 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:56.522 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:02.891 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:56.522 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:02.894 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:56.525 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:02.908 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:56.540 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:02.912 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:56.544 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:02.970 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:02.971+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:03.658 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:57.289 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:03.659 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:57.291 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:03.667 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:57.299 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:03.719 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:57.350 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:03.720 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:57.352 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:03.723 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:57.355 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:03.725 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:57.356 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:03.731 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:21:57.363 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:03.735 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:21:57.367 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:03.954 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:03.954+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:04.927 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:04.928+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:05.927 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:05.928+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:06.894 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:06.895+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:07.946 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:07.944+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:08.963 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:08.964+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:10.014 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:10.015+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:11.033 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:11.033+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:12.028 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:12.026+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:13.031 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:13.031+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:14.065 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:14.065+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:15.072 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:15.071+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:16.090 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:16.090+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:17.124 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:17.123+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:17.878 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:11.509 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:17.880 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:11.512 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:17.897 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:11.528 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:17.928 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:11.560 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:17.930 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:11.561 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:17.930 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:11.562 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:17.931 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:11.563 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:17.946 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:11.577 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:17.946 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:11.578 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:18.137 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:18.137+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:19.131 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:19.131+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:20.129 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:20.128+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:21.164 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:21.164+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:22.145 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:22.144+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:23.016 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:16.647 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:23.020 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:16.651 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:23.031 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:16.662 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:23.069 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:16.701 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:23.070 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:16.702 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:23.077 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:16.709 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:23.078 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:16.710 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:23.081 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:16.712 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:23.088 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:16.720 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:23.152 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:23.151+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:24.122 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:24.122+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:25.117 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:25.117+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:26.093 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:26.092+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:27.096 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:27.096+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:28.096 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:28.096+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:29.057 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:29.057+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:30.056 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:30.055+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:31.036 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:31.036+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:32.025 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:32.024+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:32.892 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:26.523 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:32.938 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:26.570 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:32.940 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:26.571 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:32.944 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:26.575 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:32.945 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:26.577 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:32.946 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:26.578 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:32.954 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:26.586 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:32.962 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:26.593 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:32.966 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:26.597 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:33.036 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:33.036+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:34.051 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:34.050+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:35.076 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:35.076+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:36.048 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:36.047+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:37.039 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:37.039+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:38.041 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:38.040+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:39.034 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:39.033+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:39.987 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:39.987+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:40.997 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:40.996+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:41.966 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:41.964+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:42.966 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:42.966+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:42.967 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:36.599 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:42.973 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:36.605 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:42.993 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:36.625 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:43.018 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:36.650 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:43.019 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:36.651 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:43.021 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:36.653 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:43.024 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:36.656 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:43.035 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:36.666 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:43.038 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:36.670 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:43.945 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:43.946+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:44.915 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:44.914+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:45.901 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:45.901+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:46.909 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:46.909+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:47.879 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:47.879+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:47.982 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:41.613 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:47.985 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:41.617 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:47.997 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:41.628 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:48.032 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:41.664 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:48.034 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:41.666 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:48.045 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:41.677 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:48.045 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:41.677 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:48.047 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:41.679 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:48.059 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:41.690 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:26:48.900 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:48.901+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:49.875 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:49.875+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:50.853 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:50.851+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:51.814 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:51.815+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:52.836 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:52.837+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:53.848 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:53.849+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:54.894 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:54.895+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:55.889 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:55.887+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:57.076 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:56.856+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:57.833 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:57.833+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:58.838 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:58.839+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:26:59.805 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:26:59.805+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:00.784 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:00.784+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:01.810 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:01.810+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:02.797 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:02.798+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:03.028 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:56.659 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.032 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:56.664 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.052 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:56.683 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.081 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:56.713 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.082 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:56.714 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.087 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:56.719 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.089 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:56.721 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.100 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:56.732 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.109 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:56.740 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.809 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:03.809+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:03.813 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:57.445 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.814 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:57.446 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.822 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:57.454 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.834 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:57.465 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.835 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:57.467 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.847 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:22:57.478 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.859 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:57.490 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.860 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:57.491 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:03.868 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:22:57.499 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:04.856 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:04.849+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:05.865 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:05.866+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:06.876 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:06.876+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:07.847 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:07.847+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:08.870 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:08.871+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:09.917 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:09.917+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:10.969 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:10.969+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:12.008 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:12.009+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:13.050 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:13.051+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:14.037 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:14.038+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:15.005 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:15.006+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:15.969 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:15.969+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:16.946 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:16.946+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:17.625 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:11.256 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:17.629 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:11.260 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:17.649 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:11.280 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:17.679 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:11.311 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:17.681 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:11.313 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:17.682 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:11.314 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:17.687 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:11.319 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:17.702 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:11.334 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:17.708 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:11.339 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:17.898 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:17.898+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:18.326 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:11.958 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:18.327 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:11.959 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:18.335 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:11.967 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:18.369 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:12.001 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:18.370 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:12.002 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:18.378 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:12.010 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:18.399 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:12.031 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:18.400 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:12.032 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:18.411 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:12.043 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:18.937 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:18.937+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:19.922 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:19.921+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:20.898 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:20.898+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:21.868 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:21.867+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:22.828 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:22.826+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:23.812 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:23.811+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:24.829 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:24.828+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:25.848 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:25.847+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:26.826 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:26.825+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:27.794 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:27.793+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:28.169 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:21.799 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:28.176 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:21.806 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:28.206 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:21.836 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:28.220 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:21.852 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:28.224 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:21.854 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:28.225 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:21.856 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:28.226 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:21.857 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:28.238 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:21.870 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:28.239 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:21.870 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:28.755 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:28.753+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:29.783 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:29.782+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:30.818 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:30.818+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:31.834 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:31.834+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:32.794 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:32.793+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:33.182 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:26.814 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:33.188 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:26.819 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:33.200 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:26.831 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:33.234 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:26.865 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:33.234 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:26.866 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:33.240 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:26.871 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:33.241 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:26.872 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:33.246 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:26.878 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:33.255 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:26.887 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:33.780 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:33.779+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:34.779 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:34.779+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:35.773 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:35.772+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:36.795 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:36.795+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:37.786 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:37.786+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:38.746 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:38.746+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:39.788 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:39.788+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:40.822 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:40.821+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:41.822 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:41.822+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:42.789 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:42.788+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:43.815 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:43.814+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:44.858 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:44.858+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:45.858 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:45.858+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:46.907 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:46.906+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:47.872 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:47.872+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:48.249 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:41.881 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.252 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:41.884 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.269 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:41.901 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.277 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:41.909 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.281 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:41.912 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.287 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:41.919 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.290 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:41.921 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.297 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:41.929 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.308 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:41.940 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.844 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:48.844+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:48.911 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:42.542 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.912 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:42.544 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.923 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:42.554 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.966 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:42.596 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.966 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:42.597 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.974 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:42.606 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.987 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:42.619 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.988 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:42.620 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:48.997 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:42.628 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:27:49.850 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:49.850+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:50.817 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:50.817+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:51.794 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:51.794+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:52.805 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:52.805+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:53.841 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:53.842+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:54.892 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:54.892+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:55.922 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:55.921+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:56.916 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:56.916+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:57.936 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:57.936+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:58.934 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:58.935+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:27:59.942 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:27:59.942+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:00.927 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:00.928+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:01.946 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:01.946+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:02.990 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:02.990+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:03.327 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:56.959 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:03.329 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:56.961 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:03.355 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:23:56.987 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:03.376 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:57.008 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:03.377 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:57.009 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:03.388 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:57.020 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:03.391 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:57.022 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:03.397 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:57.029 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:03.408 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:23:57.040 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:04.033 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:04.033+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:05.058 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:05.058+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:06.063 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:06.063+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:07.097 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:07.098+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:08.087 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:08.088+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:08.367 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:01.998 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:08.371 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:02.002 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:08.381 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:02.012 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:08.415 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:02.047 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:08.417 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:02.049 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:08.420 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:02.051 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:08.422 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:02.054 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:08.427 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:02.059 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:08.435 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:02.067 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:09.128 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:09.129+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:10.141 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:10.140+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:11.109 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:11.110+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:12.081 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:12.082+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:13.080 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:13.080+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:14.099 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:14.098+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:15.095 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:15.096+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:16.069 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:16.070+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:17.112 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:17.112+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:18.064 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:18.065+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:18.396 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:12.028 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:18.399 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:12.030 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:18.414 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:12.045 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:18.449 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:12.081 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:18.451 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:12.083 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:18.464 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:12.096 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:18.466 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:12.097 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:18.468 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:12.099 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:18.488 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:12.120 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:19.030 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:19.030+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:20.020 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:20.020+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:20.979 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:20.979+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:22.027 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:22.026+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:23.040 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:23.039+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:24.065 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:24.064+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:25.073 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:25.073+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:26.106 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:26.105+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:27.091 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:27.091+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:28.110 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:28.110+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:28.436 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:22.068 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:28.443 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:22.074 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:28.457 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:22.088 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:28.488 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:22.120 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:28.490 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:22.122 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:28.491 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:22.123 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:28.493 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:22.125 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:28.507 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:22.138 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:28.507 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:22.139 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:29.154 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:29.153+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:30.119 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:30.118+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:31.139 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:31.138+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:32.095 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:32.095+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:33.100 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:33.100+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:33.451 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:27.083 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:33.456 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:27.087 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:33.472 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:27.104 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:33.502 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:27.134 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:33.507 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:27.139 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:33.509 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:27.141 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:33.511 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:27.142 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:33.520 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:27.152 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:33.522 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:27.153 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:34.052 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:34.052+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:35.088 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:35.087+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:36.074 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:36.074+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:37.098 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:37.098+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:38.077 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:38.076+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:39.077 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:39.077+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:40.071 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:40.071+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:41.090 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:41.090+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:42.132 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:42.132+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:43.135 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:43.135+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:44.095 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:44.095+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:45.098 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:45.098+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:46.072 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:46.071+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:47.081 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:47.080+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:48.095 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:48.095+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:48.502 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:42.132 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:48.503 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:42.135 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:48.531 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:42.162 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:48.550 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:42.182 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:48.558 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:42.190 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:48.562 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:42.193 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:48.566 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:42.197 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:48.576 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:42.208 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:48.585 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:42.216 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:49.130 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:49.129+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:49.273 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:42.904 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:49.273 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:42.906 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:49.282 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:42.913 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:49.324 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:42.956 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:49.325 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:42.957 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:49.337 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:42.968 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:49.339 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:42.971 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:49.340 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:42.972 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:49.349 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:42.980 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:28:50.114 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:50.113+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:51.089 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:51.089+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:52.081 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:52.081+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:53.119 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:53.120+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:54.129 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:54.129+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:55.164 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:55.165+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:56.126 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:56.127+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:57.118 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:57.118+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:58.155 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:58.156+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:28:59.154 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:28:59.154+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:00.130 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:00.130+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:01.140 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:01.140+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:02.178 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:02.179+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:03.139 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:03.139+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:03.534 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:57.166 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:03.543 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:57.170 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:03.555 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:57.187 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:03.589 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:57.220 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:03.592 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:57.220 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:03.593 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:57.221 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:03.593 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:57.225 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:03.606 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:24:57.238 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:03.619 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:57.242 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:04.102 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:04.103+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:05.143 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:05.141+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:06.127 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:06.127+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:07.180 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:07.181+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:08.228 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:08.229+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:08.555 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:02.186 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:08.557 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:02.188 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:08.571 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:02.203 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:08.602 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:02.234 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:08.607 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:02.239 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:08.609 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:02.241 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:08.610 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:02.242 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:08.617 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:02.249 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:08.621 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:02.252 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:09.216 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:09.217+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:10.266 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:10.267+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:11.234 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:11.234+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:12.273 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:12.271+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:13.232 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:13.233+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:14.212 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:14.212+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:15.185 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:15.186+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:16.145 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:16.146+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:17.041 INFO:tasks.ceph.osd.6.smithi173.stderr:*** Caught signal (Aborted) ** 2024-04-09T12:29:17.041 INFO:tasks.ceph.osd.6.smithi173.stderr: in thread 28093640 thread_name:tp_osd_tp 2024-04-09T12:29:17.098 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:17.098+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:17.117 INFO:tasks.ceph.osd.6.smithi173.stderr: ceph version 18.2.2-1187-gd540ebac (d540ebaca6b131a1dd560e7f69e024b133bbaa42) reef (stable) 2024-04-09T12:29:17.118 INFO:tasks.ceph.osd.6.smithi173.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x549fdb0] 2024-04-09T12:29:17.118 INFO:tasks.ceph.osd.6.smithi173.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x54ec54c] 2024-04-09T12:29:17.118 INFO:tasks.ceph.osd.6.smithi173.stderr: 3: (ceph::HeartbeatMap::_check(ceph::heartbeat_handle_d const*, char const*, std::chrono::time_point > >)+0x26f) [0xb4e1ef] 2024-04-09T12:29:17.118 INFO:tasks.ceph.osd.6.smithi173.stderr: 4: (ceph::HeartbeatMap::reset_timeout(ceph::heartbeat_handle_d*, std::chrono::duration >, std::chrono::duration >)+0x74) [0xb4e2e4] 2024-04-09T12:29:17.118 INFO:tasks.ceph.osd.6.smithi173.stderr: 5: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x290) [0xb51db0] 2024-04-09T12:29:17.118 INFO:tasks.ceph.osd.6.smithi173.stderr: 6: ceph-osd(+0xa4a364) [0xb52364] 2024-04-09T12:29:17.118 INFO:tasks.ceph.osd.6.smithi173.stderr: 7: /lib64/libc.so.6(+0x9f802) [0x54ea802] 2024-04-09T12:29:17.118 INFO:tasks.ceph.osd.6.smithi173.stderr: 8: clone() 2024-04-09T12:29:17.175 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-09T12:29:17.168+0000 28093640 -1 *** Caught signal (Aborted) ** 2024-04-09T12:29:17.175 INFO:tasks.ceph.osd.6.smithi173.stderr: in thread 28093640 thread_name:tp_osd_tp 2024-04-09T12:29:17.175 INFO:tasks.ceph.osd.6.smithi173.stderr: 2024-04-09T12:29:17.175 INFO:tasks.ceph.osd.6.smithi173.stderr: ceph version 18.2.2-1187-gd540ebac (d540ebaca6b131a1dd560e7f69e024b133bbaa42) reef (stable) 2024-04-09T12:29:17.175 INFO:tasks.ceph.osd.6.smithi173.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x549fdb0] 2024-04-09T12:29:17.175 INFO:tasks.ceph.osd.6.smithi173.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x54ec54c] 2024-04-09T12:29:17.175 INFO:tasks.ceph.osd.6.smithi173.stderr: 3: (ceph::HeartbeatMap::_check(ceph::heartbeat_handle_d const*, char const*, std::chrono::time_point > >)+0x26f) [0xb4e1ef] 2024-04-09T12:29:17.175 INFO:tasks.ceph.osd.6.smithi173.stderr: 4: (ceph::HeartbeatMap::reset_timeout(ceph::heartbeat_handle_d*, std::chrono::duration >, std::chrono::duration >)+0x74) [0xb4e2e4] 2024-04-09T12:29:17.176 INFO:tasks.ceph.osd.6.smithi173.stderr: 5: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x290) [0xb51db0] 2024-04-09T12:29:17.176 INFO:tasks.ceph.osd.6.smithi173.stderr: 6: ceph-osd(+0xa4a364) [0xb52364] 2024-04-09T12:29:17.176 INFO:tasks.ceph.osd.6.smithi173.stderr: 7: /lib64/libc.so.6(+0x9f802) [0x54ea802] 2024-04-09T12:29:17.176 INFO:tasks.ceph.osd.6.smithi173.stderr: 8: clone() 2024-04-09T12:29:17.176 INFO:tasks.ceph.osd.6.smithi173.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-09T12:29:17.176 INFO:tasks.ceph.osd.6.smithi173.stderr: 2024-04-09T12:29:17.515 INFO:tasks.ceph.osd.6.smithi173.stderr: -6> 2024-04-09T12:29:17.168+0000 28093640 -1 *** Caught signal (Aborted) ** 2024-04-09T12:29:17.516 INFO:tasks.ceph.osd.6.smithi173.stderr: in thread 28093640 thread_name:tp_osd_tp 2024-04-09T12:29:17.516 INFO:tasks.ceph.osd.6.smithi173.stderr: 2024-04-09T12:29:17.516 INFO:tasks.ceph.osd.6.smithi173.stderr: ceph version 18.2.2-1187-gd540ebac (d540ebaca6b131a1dd560e7f69e024b133bbaa42) reef (stable) 2024-04-09T12:29:17.516 INFO:tasks.ceph.osd.6.smithi173.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x549fdb0] 2024-04-09T12:29:17.516 INFO:tasks.ceph.osd.6.smithi173.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x54ec54c] 2024-04-09T12:29:17.516 INFO:tasks.ceph.osd.6.smithi173.stderr: 3: (ceph::HeartbeatMap::_check(ceph::heartbeat_handle_d const*, char const*, std::chrono::time_point > >)+0x26f) [0xb4e1ef] 2024-04-09T12:29:17.516 INFO:tasks.ceph.osd.6.smithi173.stderr: 4: (ceph::HeartbeatMap::reset_timeout(ceph::heartbeat_handle_d*, std::chrono::duration >, std::chrono::duration >)+0x74) [0xb4e2e4] 2024-04-09T12:29:17.516 INFO:tasks.ceph.osd.6.smithi173.stderr: 5: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x290) [0xb51db0] 2024-04-09T12:29:17.517 INFO:tasks.ceph.osd.6.smithi173.stderr: 6: ceph-osd(+0xa4a364) [0xb52364] 2024-04-09T12:29:17.517 INFO:tasks.ceph.osd.6.smithi173.stderr: 7: /lib64/libc.so.6(+0x9f802) [0x54ea802] 2024-04-09T12:29:17.517 INFO:tasks.ceph.osd.6.smithi173.stderr: 8: clone() 2024-04-09T12:29:17.517 INFO:tasks.ceph.osd.6.smithi173.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-09T12:29:17.517 INFO:tasks.ceph.osd.6.smithi173.stderr: 2024-04-09T12:29:17.863 INFO:tasks.ceph.osd.6.smithi173.stderr: -52> 2024-04-09T12:29:17.168+0000 28093640 -1 *** Caught signal (Aborted) ** 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: in thread 28093640 thread_name:tp_osd_tp 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: ceph version 18.2.2-1187-gd540ebac (d540ebaca6b131a1dd560e7f69e024b133bbaa42) reef (stable) 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x549fdb0] 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x54ec54c] 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: 3: (ceph::HeartbeatMap::_check(ceph::heartbeat_handle_d const*, char const*, std::chrono::time_point > >)+0x26f) [0xb4e1ef] 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: 4: (ceph::HeartbeatMap::reset_timeout(ceph::heartbeat_handle_d*, std::chrono::duration >, std::chrono::duration >)+0x74) [0xb4e2e4] 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: 5: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x290) [0xb51db0] 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: 6: ceph-osd(+0xa4a364) [0xb52364] 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: 7: /lib64/libc.so.6(+0x9f802) [0x54ea802] 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: 8: clone() 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-09T12:29:17.864 INFO:tasks.ceph.osd.6.smithi173.stderr: 2024-04-09T12:29:18.057 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:18.057+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:18.536 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:12.168 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:18.590 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:12.221 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:18.604 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:12.236 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:18.641 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:12.271 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:18.641 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:12.272 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:18.642 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:12.273 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:18.648 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:12.280 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:18.657 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:12.289 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:18.661 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:12.293 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:19.078 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:19.078+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:20.109 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:20.109+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:20.245 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:24:56.306 35530== 2024-04-09T12:29:20.245 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:24:56.306 35530== Exit program on first error (--exit-on-first-error=yes) 2024-04-09T12:29:20.364 INFO:tasks.ceph.osd.6.smithi173.stderr:daemon-helper: command failed with exit status 42 2024-04-09T12:29:21.093 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:21.092+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:22.051 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:22.051+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:23.070 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:23.069+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:23.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-09T12:29:24.055 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:24.055+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:25.087 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:25.087+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:26.078 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:26.077+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:27.069 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:27.068+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:28.026 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:28.025+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:28.679 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:22.311 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:28.730 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:22.361 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:28.745 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:22.377 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:28.779 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:22.410 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:28.780 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:22.412 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:28.780 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:22.412 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:28.782 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:22.414 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:28.794 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:22.426 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:28.796 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:22.428 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:29.065 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:29.065+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:29.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~6s 2024-04-09T12:29:30.053 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:30.053+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:31.100 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:31.100+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:32.125 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:32.125+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:33.078 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:33.078+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:33.626 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:27.257 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:33.627 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:27.258 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:33.629 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:27.261 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:33.631 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:27.263 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:33.643 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:27.275 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:33.654 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:27.286 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:33.686 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:27.318 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:33.687 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:27.319 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:33.701 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:27.333 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:34.126 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:34.126+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:35.133 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:35.132+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:35.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~12s 2024-04-09T12:29:36.172 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:36.172+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:37.135 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:37.135+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:38.111 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:38.111+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:39.098 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:39.098+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:40.139 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:40.138+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:41.179 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:41.179+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:41.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~19s 2024-04-09T12:29:42.139 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:42.139+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:43.155 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:43.155+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:44.150 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:44.150+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:45.124 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:45.124+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:46.122 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:46.121+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:47.077 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:47.076+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:48.106 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:48.105+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:48.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~25s 2024-04-09T12:29:48.673 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:42.304 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:48.673 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:42.305 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:48.674 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:42.306 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:48.675 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:42.307 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:48.692 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:42.324 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:48.697 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:42.329 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:48.725 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:42.356 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:48.728 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:42.360 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:48.753 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:42.384 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:49.117 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:49.117+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:49.461 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:43.093 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:49.462 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:43.094 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:49.471 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:43.103 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:49.584 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:43.216 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:49.585 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:43.217 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:49.586 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:43.218 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:49.587 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:43.219 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:49.598 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:43.230 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:49.600 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:43.231 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:50.146 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:50.137+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:51.143 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:51.143+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:52.143 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:52.143+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:53.191 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:53.191+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:54.173 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:54.174+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:54.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~31s 2024-04-09T12:29:55.157 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:55.158+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:56.178 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:56.178+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:57.190 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:57.191+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:58.162 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:58.162+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:29:58.824 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:52.455 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:58.838 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:52.470 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:58.843 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:52.475 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:58.881 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:52.513 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:58.888 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:52.519 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:58.888 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:52.520 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:58.903 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:52.534 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:58.905 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:52.537 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:58.909 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:52.541 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:29:59.211 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:29:59.212+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:00.194 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:00.195+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:00.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~37s 2024-04-09T12:30:01.221 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:01.222+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:02.266 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:02.266+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:03.261 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:03.262+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:03.707 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:57.339 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:03.709 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:57.341 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:03.719 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:57.351 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:03.755 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:57.386 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:03.756 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:57.388 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:03.758 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:57.390 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:03.759 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:57.391 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:03.766 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:57.398 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:03.770 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:25:57.402 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:04.255 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:04.255+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:05.208 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:05.209+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:06.230 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:06.231+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:06.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~43s 2024-04-09T12:30:07.259 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:07.260+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:08.257 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:08.258+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:08.721 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:02.352 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:08.725 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:02.357 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:08.735 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:02.367 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:08.772 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:02.403 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:08.773 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:02.405 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:08.775 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:02.407 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:08.776 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:02.408 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:08.787 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:02.419 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:08.787 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:02.418 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:09.265 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:09.266+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:10.246 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:10.247+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:11.229 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:11.230+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:12.270 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:12.270+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:13.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~50s 2024-04-09T12:30:13.221 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:13.222+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:14.190 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:14.191+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:15.188 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:15.188+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:16.169 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:16.170+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:17.127 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:17.128+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:18.167 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:18.168+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:18.755 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:12.387 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:18.757 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:12.388 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:18.771 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:12.403 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:18.805 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:12.436 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:18.805 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:12.437 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:18.806 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:12.438 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:18.809 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:12.440 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:18.820 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:12.452 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:18.822 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:12.454 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:19.139 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:19.139+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:19.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~56s 2024-04-09T12:30:20.098 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:20.098+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:21.118 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:21.117+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:22.108 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:22.108+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:23.126 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:23.126+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:24.132 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:24.132+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:25.121 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:25.121+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:25.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~62s 2024-04-09T12:30:26.098 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:26.097+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:27.074 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:27.072+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:28.095 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:28.094+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:28.786 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:22.418 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:28.790 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:22.421 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:28.805 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:22.436 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:28.837 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:22.469 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:28.838 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:22.470 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:28.840 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:22.471 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:28.841 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:22.473 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:28.854 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:22.486 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:28.855 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:22.487 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:29.114 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:29.114+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:30.152 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:30.151+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:31.106 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:31.106+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:31.658 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~68s 2024-04-09T12:30:32.081 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:32.081+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:33.105 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:33.105+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:33.802 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:27.433 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:33.803 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:27.435 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:33.815 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:27.447 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:33.850 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:27.482 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:33.851 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:27.482 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:33.852 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:27.483 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:33.852 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:27.483 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:33.862 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:27.494 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:33.863 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:27.495 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:34.136 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:34.136+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:35.145 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:35.145+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:36.142 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:36.142+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:37.115 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:37.114+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:37.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~75s 2024-04-09T12:30:38.132 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:38.132+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:39.164 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:39.163+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:40.186 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:40.186+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:41.231 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:41.230+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:42.237 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:42.237+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:43.258 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:43.257+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:44.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~81s 2024-04-09T12:30:44.291 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:44.291+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:45.250 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:45.250+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:46.220 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:46.220+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:47.174 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:47.174+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:48.219 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:48.218+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:48.847 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:42.478 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:48.851 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:42.483 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:48.870 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:42.501 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:48.900 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:42.532 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:48.903 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:42.535 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:48.919 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:42.551 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:48.920 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:42.552 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:48.921 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:42.553 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:48.940 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:42.571 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:49.219 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:49.218+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:49.594 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:43.226 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:49.599 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:43.231 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:49.658 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:43.290 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:49.703 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:43.334 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:49.704 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:43.336 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:49.707 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:43.339 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:49.708 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:43.340 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:49.714 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:43.346 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:49.719 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:43.351 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:30:50.264 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:50.263+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:50.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~87s 2024-04-09T12:30:51.288 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:51.288+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:52.333 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:52.334+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:53.312 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:53.313+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:54.270 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:54.271+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:55.280 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:55.280+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:56.307 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:56.307+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:56.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~93s 2024-04-09T12:30:57.352 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:57.353+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:58.388 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:58.389+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:30:59.423 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:30:59.424+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:00.391 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:00.392+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:01.381 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:01.381+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:02.377 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:02.378+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:02.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~99s 2024-04-09T12:31:03.392 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:03.393+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:03.884 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:57.516 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:03.886 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:57.518 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:03.902 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:26:57.534 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:03.934 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:57.565 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:03.935 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:57.567 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:03.936 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:57.568 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:03.938 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:57.569 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:03.952 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:57.584 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:03.957 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:26:57.588 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:04.345 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:04.346+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:05.394 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:05.395+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:06.414 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:06.415+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:07.388 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:07.389+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:08.402 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:08.403+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:08.898 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:02.530 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:08.902 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:02.534 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:08.913 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:02.545 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:08.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~106s 2024-04-09T12:31:08.946 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:02.578 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:08.947 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:02.579 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:08.950 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:02.581 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:08.951 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:02.583 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:08.957 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:02.589 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:08.965 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:02.597 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:09.367 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:09.367+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:10.398 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:10.399+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:11.420 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:11.421+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:12.441 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:12.441+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:13.452 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:13.453+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:14.501 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:14.502+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:15.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~112s 2024-04-09T12:31:15.514 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:15.515+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:16.539 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:16.539+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:17.518 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:17.519+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:18.516 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:18.517+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:18.933 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:12.565 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:18.938 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:12.567 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:18.955 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:12.587 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:18.979 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:12.611 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:18.983 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:12.615 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:18.985 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:12.617 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:18.988 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:12.621 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:18.999 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:12.631 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:19.003 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:12.635 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:19.559 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:19.557+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:20.554 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:20.554+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:21.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~118s 2024-04-09T12:31:21.575 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:21.575+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:22.554 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:22.553+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:23.569 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:23.569+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:24.619 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:24.618+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:25.571 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:25.571+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:26.547 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:26.547+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:27.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~124s 2024-04-09T12:31:27.593 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:27.593+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:28.548 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:28.548+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:29.085 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:22.717 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:29.087 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:22.719 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:29.106 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:22.737 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:29.135 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:22.767 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:29.136 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:22.768 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:29.139 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:22.771 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:29.141 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:22.773 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:29.152 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:22.784 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:29.157 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:22.789 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:29.572 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:29.572+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:30.607 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:30.606+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:31.559 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:31.559+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:32.578 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:32.578+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:33.602 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:33.602+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:33.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~130s 2024-04-09T12:31:34.008 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:27.640 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:34.013 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:27.644 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:34.024 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:27.655 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:34.062 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:27.694 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:34.063 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:27.694 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:34.063 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:27.695 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:34.064 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:27.696 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:34.074 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:27.706 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:34.075 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:27.706 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:34.630 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:34.630+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:35.592 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:35.592+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:36.556 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:36.556+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:37.600 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:37.600+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:38.556 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:38.556+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:39.562 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:39.561+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:39.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~137s 2024-04-09T12:31:40.606 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:40.606+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:41.648 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:41.647+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:42.609 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:42.609+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:43.585 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:43.585+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:44.611 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:44.610+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:45.631 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:45.631+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:46.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~143s 2024-04-09T12:31:46.650 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:46.650+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:47.646 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:47.646+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:48.651 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:48.650+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:49.049 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:42.681 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:49.053 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:42.685 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:49.070 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:42.702 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:49.097 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:42.729 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:49.100 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:42.732 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:49.104 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:42.736 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:49.106 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:42.738 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:49.116 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:42.749 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:49.122 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:42.754 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:49.641 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:49.641+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:50.652 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:50.653+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:51.697 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:51.697+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:52.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~149s 2024-04-09T12:31:52.676 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:52.677+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:53.652 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:53.653+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:54.019 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:47.650 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:54.068 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:47.700 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:54.070 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:47.702 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:54.072 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:47.704 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:54.088 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:47.720 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:54.102 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:47.734 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:54.134 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:47.766 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:54.136 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:47.768 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:54.148 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:47.779 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:31:54.698 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:54.699+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:55.706 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:55.706+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:56.694 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:56.695+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:57.741 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:57.742+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:58.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~155s 2024-04-09T12:31:58.758 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:58.759+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:31:59.739 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:31:59.740+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:00.776 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:00.777+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:01.757 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:01.757+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:02.770 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:02.771+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:03.812 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:03.812+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:04.096 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:57.728 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:04.101 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:57.733 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:04.122 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:57.752 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:04.153 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:57.784 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:04.154 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:57.786 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:04.158 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:57.790 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:04.160 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:57.792 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:04.167 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:57.800 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:04.174 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:27:57.806 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:04.787 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:04.788+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:04.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~161s 2024-04-09T12:32:05.785 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:05.785+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:06.748 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:06.749+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:07.793 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:07.794+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:08.789 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:08.790+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:09.771 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:09.771+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:10.794 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:10.795+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:11.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~168s 2024-04-09T12:32:11.822 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:11.822+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:12.776 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:12.777+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:13.809 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:13.810+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:14.138 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:07.769 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:14.144 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:07.775 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:14.163 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:07.795 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:14.190 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:07.822 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:14.194 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:07.826 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:14.195 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:07.826 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:14.196 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:07.828 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:14.211 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:07.843 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:14.211 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:07.843 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:14.843 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:14.842+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:15.845 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:15.846+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:16.840 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:16.840+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:17.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~174s 2024-04-09T12:32:17.861 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:17.862+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:18.841 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:18.841+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:19.150 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:12.782 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:19.155 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:12.787 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:19.166 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:12.797 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:19.200 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:12.831 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:19.201 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:12.833 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:19.202 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:12.834 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:19.203 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:12.835 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:19.212 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:12.844 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:19.214 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:12.846 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:19.887 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:19.887+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:20.861 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:20.860+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:21.883 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:21.883+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:22.910 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:22.910+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:23.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~180s 2024-04-09T12:32:23.882 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:23.881+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:24.917 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:24.917+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:25.960 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:25.960+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:26.946 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:26.946+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:27.960 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:27.960+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:28.976 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:28.975+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:29.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~186s 2024-04-09T12:32:29.982 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:29.981+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:30.956 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:30.956+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:31.937 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:31.936+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:32.890 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:32.890+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:33.867 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:33.867+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:34.233 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:27.865 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:34.235 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:27.867 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:34.256 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:27.888 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:34.285 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:27.917 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:34.286 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:27.918 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:34.287 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:27.919 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:34.305 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:27.936 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:34.305 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:27.936 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:34.327 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:27.959 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:34.912 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:34.912+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:35.016 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:28.648 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:35.017 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:28.649 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:35.025 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:28.657 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:35.122 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:28.754 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:35.123 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:28.755 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:35.132 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:28.763 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:35.132 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:28.764 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:35.133 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:28.765 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:35.141 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:28.773 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:35.868 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~193s 2024-04-09T12:32:35.887 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:35.887+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:36.878 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:36.878+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:37.830 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:37.830+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:38.795 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:38.795+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:39.753 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:39.753+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:40.753 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:40.753+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:41.306 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:34.938 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:41.319 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:34.951 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:41.321 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:34.953 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:41.322 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:34.954 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:41.357 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:34.988 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:41.363 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:34.995 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:41.374 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:35.006 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:41.384 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:35.016 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:41.386 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:35.018 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:41.742 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:41.742+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:42.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~199s 2024-04-09T12:32:42.792 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:42.792+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:43.835 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:43.835+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:44.823 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:44.824+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:45.842 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:45.842+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:46.856 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:46.855+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:47.861 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:47.861+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:48.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~205s 2024-04-09T12:32:48.863 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:48.863+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:49.268 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:42.900 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:49.271 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:42.903 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:49.285 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:42.917 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:49.316 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:42.948 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:49.317 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:42.949 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:49.321 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:42.953 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:49.322 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:42.954 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:49.329 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:42.961 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:49.340 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:42.972 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:49.913 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:49.914+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:50.928 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:50.927+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:51.907 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:51.908+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:52.910 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:52.910+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:53.956 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:53.957+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:54.286 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:47.917 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:54.288 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:47.920 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:54.301 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:47.932 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:54.337 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:47.969 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:54.338 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:47.970 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:54.350 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:47.981 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:54.350 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:47.981 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:54.350 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:47.982 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:54.360 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:47.992 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:32:54.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~211s 2024-04-09T12:32:54.909 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:54.910+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:55.923 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:55.924+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:56.950 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:56.950+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:57.992 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:57.993+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:58.945 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:58.946+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:32:59.903 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:32:59.904+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:00.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~217s 2024-04-09T12:33:00.953 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:00.954+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:01.929 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:01.930+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:02.925 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:02.926+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:03.938 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:03.939+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:04.317 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:57.948 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:04.319 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:57.950 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:04.320 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:57.952 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:04.323 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:57.956 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:04.337 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:28:57.969 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:04.339 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:57.971 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:04.373 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:58.005 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:04.379 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:58.011 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:04.395 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:28:58.027 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:04.926 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:04.927+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:05.895 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:05.896+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:06.898 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:06.898+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:06.918 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~224s 2024-04-09T12:33:07.943 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:07.943+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:08.933 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:08.934+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:09.909 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:09.909+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:10.876 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:10.875+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:11.910 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:11.911+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:12.934 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:12.935+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:13.128 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~230s 2024-04-09T12:33:13.953 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:13.954+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:14.377 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:08.009 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:14.379 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:08.011 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:14.394 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:08.026 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:14.433 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:08.065 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:14.434 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:08.066 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:14.435 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:08.067 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:14.436 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:08.068 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:14.450 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:08.082 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:14.452 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:08.084 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:14.972 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:14.973+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:15.995 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:15.996+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:17.036 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:17.037+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:18.064 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:18.064+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:19.055 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:19.054+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:19.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~236s 2024-04-09T12:33:19.356 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:12.987 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:19.358 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:12.990 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:19.369 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:13.001 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:19.408 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:13.039 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:19.409 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:13.041 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:19.413 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:13.045 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:19.415 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:13.046 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:19.420 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:13.053 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:19.426 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:13.058 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:20.059 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:20.059+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:21.096 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:21.096+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:22.143 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:22.142+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:23.156 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:23.155+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:24.189 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:24.189+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:25.239 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:25.238+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:25.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~242s 2024-04-09T12:33:26.228 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:26.228+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:27.276 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:27.276+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:28.321 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:28.321+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:29.327 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:29.327+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:30.317 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:30.317+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:31.287 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:31.287+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:31.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~248s 2024-04-09T12:33:32.306 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:32.307+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:33.327 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:33.327+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:34.289 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:34.288+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:34.412 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:28.044 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:34.416 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:28.048 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:34.435 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:28.067 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:34.465 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:28.097 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:34.466 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:28.098 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:34.483 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:28.116 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:34.487 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:28.118 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:34.493 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:28.125 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:34.514 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:28.145 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:35.187 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:28.819 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:35.188 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:28.820 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:35.196 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:28.828 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:35.290 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:35.290+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:35.297 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:28.929 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:35.298 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:28.930 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:35.306 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:28.938 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:35.307 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:28.939 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:35.307 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:28.939 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:35.316 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:28.948 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:36.268 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:36.268+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:37.227 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:37.227+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:37.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~255s 2024-04-09T12:33:38.229 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:38.230+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:39.265 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:39.264+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:40.226 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:40.225+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:41.210 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:41.209+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:42.169 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:42.169+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:43.207 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:43.207+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:44.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~261s 2024-04-09T12:33:44.187 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:44.187+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:45.189 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:45.189+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:46.202 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:46.202+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:47.252 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:47.252+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:48.255 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:48.255+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:49.285 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:49.286+0000 12c5f640 -1 osd.1 594 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:49.578 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:43.209 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:49.580 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:43.212 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:49.606 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:43.238 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:49.644 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:43.276 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:49.651 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:43.283 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:49.652 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:43.283 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:49.656 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:43.287 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:49.672 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:43.303 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:49.682 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:43.314 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:50.261 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:50.262+0000 12c5f640 -1 osd.1 595 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:50.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~267s 2024-04-09T12:33:51.219 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:51.220+0000 12c5f640 -1 osd.1 596 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:52.202 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:52.203+0000 12c5f640 -1 osd.1 597 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:53.182 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:53.181+0000 12c5f640 -1 osd.1 597 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:54.173 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:54.173+0000 12c5f640 -1 osd.1 597 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:54.499 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:48.131 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:54.504 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:48.136 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:54.519 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:48.150 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:54.550 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:48.182 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:54.551 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:48.183 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:54.556 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:48.188 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:54.557 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:48.189 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:54.563 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:48.195 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:54.570 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:48.202 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:55.142 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:55.142+0000 12c5f640 -1 osd.1 598 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:56.152 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:56.153+0000 12c5f640 -1 osd.1 599 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:56.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~273s 2024-04-09T12:33:57.163 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:57.163+0000 12c5f640 -1 osd.1 599 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:58.201 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:58.201+0000 12c5f640 -1 osd.1 599 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:59.175 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:33:59.176+0000 12c5f640 -1 osd.1 599 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:33:59.599 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:53.231 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:59.601 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:53.233 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:59.617 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:29:53.249 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:59.647 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:53.279 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:59.649 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:53.281 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:59.650 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:53.282 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:59.652 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:53.284 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:59.661 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:53.293 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:33:59.665 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:29:53.296 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:00.130 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:00.131+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:01.168 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:01.169+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:02.180 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:02.181+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:02.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~279s 2024-04-09T12:34:03.224 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:03.225+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:04.248 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:04.249+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:05.290 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:05.291+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:06.287 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:06.288+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:07.323 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:07.324+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:08.372 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:08.372+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:09.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~286s 2024-04-09T12:34:09.387 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:09.388+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:10.424 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:10.425+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:11.448 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:11.449+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:12.442 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:12.443+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:13.480 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:13.481+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:14.516 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:14.517+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:14.544 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:30:08.175 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:14.546 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:30:08.178 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:14.566 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:30:08.198 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:14.597 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:08.229 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:14.599 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:08.231 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:14.600 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:30:08.232 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:14.601 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:30:08.233 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:14.616 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:08.249 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:14.619 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:30:08.251 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:15.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~292s 2024-04-09T12:34:15.259 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:08.891 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:15.260 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:08.892 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:15.268 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:08.900 34986== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:15.329 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:30:08.961 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:15.329 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:30:08.961 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:15.330 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:30:08.962 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:15.330 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:30:08.962 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:15.339 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:30:08.970 34922== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:15.339 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:30:08.970 34916== Warning: unimplemented fcntl command: 1036 2024-04-09T12:34:15.552 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:15.553+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:16.586 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:16.587+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:17.636 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:17.636+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:18.622 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:18.622+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:19.635 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:19.635+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:20.594 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:20.593+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:21.014 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:34:21.014+0000 ec57640 -1 osd.3 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4183.0:58 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e594) 2024-04-09T12:34:21.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~298s 2024-04-09T12:34:21.613 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:21.613+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:21.989 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:34:21.988+0000 ec57640 -1 osd.3 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4183.0:58 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e594) 2024-04-09T12:34:22.619 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:22.618+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:23.003 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:34:23.003+0000 ec57640 -1 osd.3 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4183.0:58 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e594) 2024-04-09T12:34:23.613 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:23.613+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:24.053 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:34:24.053+0000 ec57640 -1 osd.3 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4183.0:58 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e594) 2024-04-09T12:34:24.627 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:24.627+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:25.069 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:34:25.069+0000 ec57640 -1 osd.3 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4183.0:58 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e594) 2024-04-09T12:34:25.652 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:25.651+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:26.067 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:34:26.066+0000 ec57640 -1 osd.3 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4183.0:58 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e594) 2024-04-09T12:34:26.690 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:26.690+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:27.095 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:34:27.095+0000 ec57640 -1 osd.3 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4183.0:58 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e594) 2024-04-09T12:34:27.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~304s 2024-04-09T12:34:27.645 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-04-09T12:34:27.678 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:27.678+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:28.109 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:34:28.109+0000 ec57640 -1 osd.3 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4183.0:58 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e594) 2024-04-09T12:34:28.711 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:28.711+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:28.853 INFO:tasks.ceph.osd.0:Sent signal 15 2024-04-09T12:34:28.854 INFO:tasks.ceph.osd.1:Sent signal 15 2024-04-09T12:34:28.854 INFO:tasks.ceph.osd.2:Sent signal 15 2024-04-09T12:34:28.854 INFO:tasks.ceph.osd.3:Sent signal 15 2024-04-09T12:34:28.855 INFO:tasks.ceph.osd.4:Sent signal 15 2024-04-09T12:34:28.855 INFO:tasks.ceph.osd.5:Sent signal 15 2024-04-09T12:34:28.855 INFO:tasks.ceph.osd.7:Sent signal 15 2024-04-09T12:34:28.855 INFO:tasks.ceph.mon.a:Sent signal 15 2024-04-09T12:34:28.855 INFO:tasks.ceph.mon.c:Sent signal 15 2024-04-09T12:34:28.856 INFO:tasks.ceph.mon.b:Sent signal 15 2024-04-09T12:34:28.856 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-04-09T12:34:28.856 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-04-09T12:34:28.868 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:34:28.859+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 35230) UID: 0 2024-04-09T12:34:28.868 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:34:28.861+0000 b67d640 -1 osd.3 600 *** Got signal Terminated *** 2024-04-09T12:34:28.869 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:34:28.861+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 35527) UID: 0 2024-04-09T12:34:28.869 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-09T12:34:28.862+0000 b67d640 -1 osd.7 600 *** Got signal Terminated *** 2024-04-09T12:34:28.871 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:34:28.859+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 35213) UID: 0 2024-04-09T12:34:28.872 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-09T12:34:28.861+0000 b67d640 -1 osd.0 600 *** Got signal Terminated *** 2024-04-09T12:34:28.873 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:34:28.861+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 35520) UID: 0 2024-04-09T12:34:28.873 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-09T12:34:28.863+0000 b67d640 -1 osd.4 600 *** Got signal Terminated *** 2024-04-09T12:34:28.873 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:34:28.861+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 35524) UID: 0 2024-04-09T12:34:28.874 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:34:28.860+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 35222) UID: 0 2024-04-09T12:34:28.874 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:28.860+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 35221) UID: 0 2024-04-09T12:34:28.874 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-09T12:34:28.862+0000 b67d640 -1 osd.2 600 *** Got signal Terminated *** 2024-04-09T12:34:28.876 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:28.862+0000 b67d640 -1 osd.1 600 *** Got signal Terminated *** 2024-04-09T12:34:28.876 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-09T12:34:28.863+0000 b67d640 -1 osd.5 600 *** Got signal Terminated *** 2024-04-09T12:34:28.877 INFO:tasks.ceph.mon.b.smithi173.stderr:2024-04-09T12:34:28.863+0000 a14d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 34982) UID: 0 2024-04-09T12:34:28.878 INFO:tasks.ceph.mon.c.smithi029.stderr:2024-04-09T12:34:28.862+0000 a14d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 34890) UID: 0 2024-04-09T12:34:28.878 INFO:tasks.ceph.mon.c.smithi029.stderr:2024-04-09T12:34:28.864+0000 a14d640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-04-09T12:34:28.879 INFO:tasks.ceph.mon.a.smithi029.stderr:2024-04-09T12:34:28.862+0000 a14d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 34888) UID: 0 2024-04-09T12:34:28.883 INFO:tasks.ceph.mon.a.smithi029.stderr:2024-04-09T12:34:28.864+0000 a14d640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-09T12:34:28.884 INFO:tasks.ceph.mon.b.smithi173.stderr:2024-04-09T12:34:28.865+0000 a14d640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-09T12:34:29.057 INFO:tasks.ceph.mgr.y.smithi029.stderr:daemon-helper: command crashed with signal 15 2024-04-09T12:34:29.062 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-09T12:34:29.062+0000 ec57640 -1 osd.3 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4183.0:58 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e594) 2024-04-09T12:34:29.594 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:30:23.226 34916== 2024-04-09T12:34:29.595 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:30:23.226 34916== Exit program on first error (--exit-on-first-error=yes) 2024-04-09T12:34:29.657 INFO:tasks.ceph.mon.a.smithi029.stderr:daemon-helper: command failed with exit status 42 2024-04-09T12:34:29.688 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:29.689+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:30.726 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:30.725+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:31.701 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:31.701+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:32.735 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:32.734+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:33.755 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-09T12:34:33.755+0000 12c5f640 -1 osd.1 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4804.0:4994 205.9 205:973ccd0b:test-rados-api-smithi029-41041-50::foo:head [read 0~1] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e585) 2024-04-09T12:34:37.478 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:30:31.110 34922== 2024-04-09T12:34:37.478 INFO:tasks.ceph.mon.c.smithi029.stderr:==00:00:30:31.110 34922== Exit program on first error (--exit-on-first-error=yes) 2024-04-09T12:34:37.666 INFO:tasks.ceph.mon.c.smithi029.stderr:daemon-helper: command failed with exit status 42 2024-04-09T12:57:38.909 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:53:32.538 34986== 2024-04-09T12:57:38.909 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:53:32.538 34986== Exit program on first error (--exit-on-first-error=yes) 2024-04-09T12:57:38.991 INFO:tasks.ceph.mon.b.smithi173.stderr:daemon-helper: command failed with exit status 42 2024-04-09T18:06:29.098 INFO:tasks.workunit.client.0.smithi029.stderr:++ cleanup 2024-04-09T18:06:29.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ pkill -P 40645 2024-04-09T18:06:29.131 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-09T18:06:29.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ true 2024-04-09T18:06:29.131 INFO:tasks.workunit.client.0.smithi029.stdout: api_tier_pp: checking fo 2024-04-09T18:06:29.132 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2024-04-09T18:06:29.132 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-09T18:06:29.429 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi029 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2024-04-09T18:06:29.635 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7f18ee2c431c44ad972a61621d1c2393 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi029 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2024-04-09T18:06:29.638 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-09T18:06:29.648 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-09T18:06:29.649 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-09T18:06:29.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.775+0000 7f818bd3d640 10 monclient: get_monmap_and_config 2024-04-09T18:06:29.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.775+0000 7f818bd3d640 10 monclient: build_initial_monmap 2024-04-09T18:06:29.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.775+0000 7f818bd3d640 10 monclient: monmap: 2024-04-09T18:06:29.758 INFO:teuthology.orchestra.run.smithi029.stderr:epoch 0 2024-04-09T18:06:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:fsid 1673ebad-34a7-414e-b498-c4f5250b317b 2024-04-09T18:06:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:last_changed 2024-04-09T18:06:29.776397+0000 2024-04-09T18:06:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:created 2024-04-09T18:06:29.776397+0000 2024-04-09T18:06:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:min_mon_release 0 (unknown) 2024-04-09T18:06:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:election_strategy: 1 2024-04-09T18:06:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:0: v1:172.21.15.29:6789/0 mon.noname-a-legacy 2024-04-09T18:06:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-04-09T18:06:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-b 2024-04-09T18:06:29.760 INFO:teuthology.orchestra.run.smithi029.stderr:3: v2:172.21.15.29:3300/0 mon.noname-a 2024-04-09T18:06:29.760 INFO:teuthology.orchestra.run.smithi029.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-04-09T18:06:29.760 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-09T18:06:29.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.776+0000 7f818bd3d640 1 Processor -- start 2024-04-09T18:06:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.776+0000 7f818bd3d640 1 -- start start 2024-04-09T18:06:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.776+0000 7f818bd3d640 10 monclient: init 2024-04-09T18:06:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 10 monclient: _reopen_session rank -1 2024-04-09T18:06:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2024-04-09T18:06:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f818413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 10 monclient(hunting): picked mon.noname-a con 0x7f81840addf0 addr v2:172.21.15.29:3300/0 2024-04-09T18:06:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f818406fef0 addr v1:172.21.15.29:6789/0 2024-04-09T18:06:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f818413bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 10 monclient(hunting): picked mon.noname-c con 0x7f8184071d60 addr v2:172.21.15.173:3300/0 2024-04-09T18:06:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f818406fef0 2024-04-09T18:06:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f81840addf0 2024-04-09T18:06:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8184071d60 2024-04-09T18:06:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 10 monclient(hunting): _renew_subs 2024-04-09T18:06:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818bd3d640 10 monclient(hunting): authenticate will time out at 23055.896364s 2024-04-09T18:06:29.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f818406fef0 legacy=0x7f8184071650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:29.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 msgr2=0x7f818413b630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:29.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f818413b630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:29.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 msgr2=0x7f818413bb70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:29.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.777+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f818413bb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:29.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.978+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 msgr2=0x7f818413b630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:29.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.978+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f818406fef0 legacy=0x7f8184071650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:29.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.978+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f818413b630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:29.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.978+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 msgr2=0x7f818413bb70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:29.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:29.978+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f818413bb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:30.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:30.379+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 msgr2=0x7f818413b630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:30.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:30.379+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f818406fef0 legacy=0x7f8184071650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:30.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:30.379+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f818413b630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:30.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:30.379+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 msgr2=0x7f818413bb70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:30.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:30.379+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f818413bb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:31.180+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f818406fef0 legacy=0x7f8184071650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:31.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:31.180+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 msgr2=0x7f818413b630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:31.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:31.180+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f818413b630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:31.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:31.180+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 msgr2=0x7f818413bb70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:31.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:31.180+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f818413bb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:32.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:06:32.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:06:32.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:06:32.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:06:32.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 msgr2=0x7f818413bb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:32.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f818413bb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:32.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 msgr2=0x7f818413b630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:32.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f818413b630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:32.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f818406fef0 legacy=0x7f8184071650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:32.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 10 monclient: _add_conns ranks=[2,1] 2024-04-09T18:06:32.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:32.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f81680058a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:06:32.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8168008330 addr v1:172.21.15.173:6789/0 2024-04-09T18:06:32.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168008330 2024-04-09T18:06:32.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:32.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f81680058a0 2024-04-09T18:06:32.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:06:32.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:32.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:32.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.777+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168008330 legacy=0x7f816800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:32.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.978+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:32.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.978+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:32.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:32.978+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168008330 legacy=0x7f816800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:33.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:33.378+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:33.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:33.378+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:33.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:33.378+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168008330 legacy=0x7f816800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:34.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:34.179+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:34.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:34.179+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:34.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:34.179+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168008330 legacy=0x7f816800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:35.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:06:35.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:06:35.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:06:35.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:06:35.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:35.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:35.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168008330 legacy=0x7f816800a7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:35.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 10 monclient: _add_conns ranks=[2,4,3,1,0] 2024-04-09T18:06:35.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:35.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f81680058a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:06:35.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:06:35.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f816800c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:35.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8184071d60 addr v2:172.21.15.173:3300/0 2024-04-09T18:06:35.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f816800c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:35.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f81840addf0 addr v2:172.21.15.29:3300/0 2024-04-09T18:06:35.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:35.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f81840addf0 2024-04-09T18:06:35.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:35.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8184071d60 2024-04-09T18:06:35.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:35.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816800cc80 con 0x7f81680058a0 2024-04-09T18:06:35.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:06:35.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:35.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:35.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 msgr2=0x7f816800c690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:35.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f816800c690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:35.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 msgr2=0x7f816800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:35.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.777+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f816800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:35.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.978+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:35.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.978+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 msgr2=0x7f816800c690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:35.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.978+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:35.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.978+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f816800c690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:35.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.978+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 msgr2=0x7f816800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:35.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:35.978+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f816800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:36.379+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:36.379+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 msgr2=0x7f816800c690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:36.379+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:36.379+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f816800c690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:36.379+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 msgr2=0x7f816800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:36.379+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f816800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:37.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:37.180+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 msgr2=0x7f816800c690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:37.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:37.180+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:37.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:37.180+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f816800c690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:37.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:37.180+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:37.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:37.180+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 msgr2=0x7f816800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:37.180+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f816800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:38.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:06:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:06:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:06:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:06:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680058a0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 msgr2=0x7f816800c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8184071d60 0x7f816800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 msgr2=0x7f816800c690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81840addf0 0x7f816800c690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 10 monclient: _add_conns ranks=[1,0] 2024-04-09T18:06:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f816800afc0 addr v1:172.21.15.173:6789/0 2024-04-09T18:06:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f816800bae0 addr v1:172.21.15.29:6789/0 2024-04-09T18:06:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f816800bae0 2024-04-09T18:06:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f816800afc0 2024-04-09T18:06:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:06:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f816800bae0 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.777+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.978+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f816800bae0 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:38.978+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:39.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:39.379+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f816800bae0 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:39.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:39.379+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:40.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:40.180+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f816800bae0 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:40.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:40.180+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:41.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:06:41.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:06:41.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:06:41.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:06:41.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:41.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f816800bae0 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:41.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 10 monclient: _add_conns ranks=[0,1,2,3,4] 2024-04-09T18:06:41.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168009f60 addr v1:172.21.15.29:6789/0 2024-04-09T18:06:41.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:06:41.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f816800afc0 addr v1:172.21.15.173:6789/0 2024-04-09T18:06:41.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800c0d0 0x7f8168007cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:41.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f816800c0d0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:06:41.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8168005480 con 0x7f8168009f60 2024-04-09T18:06:41.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f816800afc0 2024-04-09T18:06:41.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800c0d0 2024-04-09T18:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800c0d0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800c0d0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.777+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:41.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.978+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:41.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.978+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800c0d0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:41.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.978+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800c0d0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:41.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:41.978+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:42.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:42.379+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:42.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:42.379+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800c0d0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:42.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:42.379+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800c0d0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:42.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:42.379+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:43.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:43.180+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:43.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:43.180+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800c0d0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:43.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:43.180+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800c0d0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:43.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:43.180+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:44.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:06:44.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:06:44.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:06:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:06:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800c0d0 msgr2=0x7f8168007cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800c0d0 0x7f8168007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 10 monclient: _add_conns ranks=[3,4] 2024-04-09T18:06:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800c7e0 0x7f816800a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800c7e0 addr v2:172.21.15.29:3300/0 2024-04-09T18:06:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f260 0x7f816800f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f816800f260 addr v2:172.21.15.173:3300/0 2024-04-09T18:06:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800c7e0 2024-04-09T18:06:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f816800f260 2024-04-09T18:06:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:06:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800c7e0 msgr2=0x7f816800a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800c7e0 0x7f816800a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800f260 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.778+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f260 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:44.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.979+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800c7e0 msgr2=0x7f816800a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:44.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.979+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800c7e0 0x7f816800a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:44.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.979+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800f260 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:44.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:44.979+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f260 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:45.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:45.380+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800c7e0 msgr2=0x7f816800a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:45.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:45.380+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800c7e0 0x7f816800a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:45.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:45.380+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800f260 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:45.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:45.380+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f260 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:46.181+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800c7e0 msgr2=0x7f816800a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:46.181+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800c7e0 0x7f816800a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:46.181+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800f260 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:46.181+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f260 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:06:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:06:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:06:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:06:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800f260 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f260 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800c7e0 msgr2=0x7f816800a470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800c7e0 0x7f816800a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 10 monclient: _add_conns ranks=[4,0,1,2,3] 2024-04-09T18:06:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f816800fbb0 addr v2:172.21.15.173:3300/0 2024-04-09T18:06:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168009f60 addr v1:172.21.15.29:6789/0 2024-04-09T18:06:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:06:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f816800afc0 addr v1:172.21.15.173:6789/0 2024-04-09T18:06:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168009f60 2024-04-09T18:06:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8168005480 con 0x7f816800afc0 2024-04-09T18:06:47.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:47.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800fbb0 2024-04-09T18:06:47.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:06:47.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:47.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:47.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:47.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.778+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:47.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.979+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:47.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.979+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:47.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.979+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:47.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:47.979+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:48.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:48.380+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:48.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:48.380+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:48.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:48.380+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:48.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:48.380+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:49.181+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:49.181+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:49.181+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:49.181+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:06:50.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:06:50.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:06:50.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:06:50.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:50.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:50.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:50.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:50.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 10 monclient: _add_conns ranks=[3,2] 2024-04-09T18:06:50.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800a470 0x7f816800f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:50.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800a470 addr v2:172.21.15.29:3300/0 2024-04-09T18:06:50.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680104d0 0x7f8168010980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:50.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f81680104d0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:06:50.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:50.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800a470 2024-04-09T18:06:50.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f81680104d0 2024-04-09T18:06:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:06:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800a470 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680104d0 msgr2=0x7f8168010980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800a470 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.778+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680104d0 0x7f8168010980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:50.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.979+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680104d0 msgr2=0x7f8168010980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:50.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.979+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800a470 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.979+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800a470 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:50.979+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680104d0 0x7f8168010980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:51.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:51.380+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800a470 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:51.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:51.380+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680104d0 msgr2=0x7f8168010980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:51.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:51.380+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800a470 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:51.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:51.380+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680104d0 0x7f8168010980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:52.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:52.181+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800a470 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:52.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:52.181+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680104d0 msgr2=0x7f8168010980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:52.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:52.181+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800a470 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:52.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:52.181+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680104d0 0x7f8168010980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:53.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:06:53.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:06:53.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:06:53.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:06:53.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680104d0 msgr2=0x7f8168010980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:53.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81680104d0 0x7f8168010980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:53.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800a470 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:53.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800a470 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:53.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 10 monclient: _add_conns ranks=[1,4,3,0,2] 2024-04-09T18:06:53.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f816800afc0 addr v1:172.21.15.173:6789/0 2024-04-09T18:06:53.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:53.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f816800fbb0 addr v2:172.21.15.173:3300/0 2024-04-09T18:06:53.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:53.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f8168007cf0 addr v2:172.21.15.29:3300/0 2024-04-09T18:06:53.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:06:53.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f816800afc0 2024-04-09T18:06:53.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:53.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168007cf0 2024-04-09T18:06:53.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:53.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f816800fbb0 2024-04-09T18:06:53.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:06:53.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 msgr2=0x7f816801c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:53.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801c6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:53.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:53.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:53.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.778+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:53.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.979+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 msgr2=0x7f816801c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:53.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.979+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801c6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:53.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.979+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:53.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.979+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:53.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:53.979+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:54.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:54.380+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 msgr2=0x7f816801c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:54.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:54.380+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801c6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:54.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:54.380+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:54.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:54.380+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:54.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:54.380+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:55.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:55.181+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 msgr2=0x7f816801c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:55.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:55.181+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801c6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:55.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:55.181+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:06:55.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:55.181+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:55.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:55.181+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:56.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:06:56.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:06:56.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:06:56.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:06:56.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:56.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800fbb0 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:56.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 msgr2=0x7f816801c6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:56.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801c6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:56.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:56.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 10 monclient: _add_conns ranks=[0,2] 2024-04-09T18:06:56.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168009f60 addr v1:172.21.15.29:6789/0 2024-04-09T18:06:56.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:56.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f816800f670 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:06:56.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168009f60 2024-04-09T18:06:56.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:56.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800f670 2024-04-09T18:06:56.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:06:56.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:56.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:56.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.779+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:56.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.980+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:56.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.980+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:56.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:56.980+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:57.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:57.381+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:57.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:57.381+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:57.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:57.381+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:06:58.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:58.182+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:58.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:58.182+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:06:58.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:58.182+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:06:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:06:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:06:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:06:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:06:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:06:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f81680097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:06:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 10 monclient: _add_conns ranks=[1,2,3,0,4] 2024-04-09T18:06:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f816800afc0 addr v1:172.21.15.173:6789/0 2024-04-09T18:06:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f816800f670 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:06:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:06:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f8168007cf0 addr v2:172.21.15.29:3300/0 2024-04-09T18:06:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:06:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f816800afc0 2024-04-09T18:06:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168007cf0 2024-04-09T18:06:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:06:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f816800f670 2024-04-09T18:06:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:06:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:06:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.779+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:06:59.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.980+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:06:59.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.980+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:06:59.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.980+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:59.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.980+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:06:59.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:06:59.980+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:00.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:00.381+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:00.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:00.381+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:00.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:00.381+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:00.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:00.381+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:00.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:00.381+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:01.182+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:01.182+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:01.182+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:01.182+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:01.182+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:02.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:02.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:02.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:02.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:02.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:02.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:02.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:02.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168007cf0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:02.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:02.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 10 monclient: _add_conns ranks=[4,0] 2024-04-09T18:07:02.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:02.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168010e40 addr v2:172.21.15.173:3300/0 2024-04-09T18:07:02.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168009f60 addr v1:172.21.15.29:6789/0 2024-04-09T18:07:02.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168009f60 2024-04-09T18:07:02.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:02.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168010e40 2024-04-09T18:07:02.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:02.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f816800fab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:02.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:02.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.779+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:02.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.980+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f816800fab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.980+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:02.980+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:03.381+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f816800fab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:03.381+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:03.381+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:04.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:04.182+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f816800fab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:04.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:04.182+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:04.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:04.182+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:05.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:05.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:05.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:05.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:05.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:05.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:05.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009f60 legacy=0x7f816800fab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:05.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2024-04-09T18:07:05.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:05.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:07:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168010e40 addr v2:172.21.15.173:3300/0 2024-04-09T18:07:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f816800afc0 addr v1:172.21.15.173:6789/0 2024-04-09T18:07:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f816800f670 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:07:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f816800afc0 2024-04-09T18:07:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168010e40 2024-04-09T18:07:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:05.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f816800f670 2024-04-09T18:07:05.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:05.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:05.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:05.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:05.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:05.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.780+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:05.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.981+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:05.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.981+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:05.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.981+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:05.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.981+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:05.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:05.981+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:06.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:06.382+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:06.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:06.382+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:06.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:06.382+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:06.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:06.382+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:06.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:06.382+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:07.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:07.183+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:07.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:07.183+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:07.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:07.183+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:07.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:07.183+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:07.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:07.183+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:08.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:08.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:08.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:08.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:08.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:08.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:08.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:08.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:08.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afc0 legacy=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:08.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 10 monclient: _add_conns ranks=[3,0] 2024-04-09T18:07:08.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009f60 0x7f816800fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:08.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f8168009f60 addr v2:172.21.15.29:3300/0 2024-04-09T18:07:08.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168007cb0 addr v1:172.21.15.29:6789/0 2024-04-09T18:07:08.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168007cb0 2024-04-09T18:07:08.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:08.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168009f60 2024-04-09T18:07:08.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:08.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009f60 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:08.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:08.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.780+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009f60 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.981+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009f60 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.981+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:08.981+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009f60 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:09.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:09.382+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:09.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:09.382+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009f60 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:09.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:09.382+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009f60 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:10.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:10.183+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009f60 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:10.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:10.183+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:10.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:10.183+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009f60 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:11.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:11.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:11.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:11.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:11.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009f60 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:11.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009f60 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:11.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:11.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 10 monclient: _add_conns ranks=[0,4,2,1,3] 2024-04-09T18:07:11.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168007cb0 addr v1:172.21.15.29:6789/0 2024-04-09T18:07:11.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:07:11.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:11.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168010e40 addr v2:172.21.15.173:3300/0 2024-04-09T18:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009f60 0x7f8168010900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168009f60 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.780+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.781+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f8168007cb0 2024-04-09T18:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.781+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.781+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168010e40 2024-04-09T18:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.781+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.781+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009f60 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:11.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.781+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168009f60 2024-04-09T18:07:11.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.781+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009f60 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:11.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.781+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:11.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.781+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:11.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.781+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:11.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.982+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009f60 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:11.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.982+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:11.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.982+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009f60 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:11.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.982+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:11.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:11.982+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:12.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:12.383+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009f60 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:12.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:12.383+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:12.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:12.383+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009f60 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:12.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:12.383+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:12.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:12.383+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:13.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:13.184+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009f60 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:13.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:13.184+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:13.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:13.184+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009f60 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:13.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:13.184+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:13.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:13.184+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009f60 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009f60 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:14.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:14.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:14.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:14.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 10 monclient: _add_conns ranks=[3,1] 2024-04-09T18:07:14.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:14.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800afc0 addr v2:172.21.15.29:3300/0 2024-04-09T18:07:14.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f816800f670 addr v1:172.21.15.173:6789/0 2024-04-09T18:07:14.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f816800f670 2024-04-09T18:07:14.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:14.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800afc0 2024-04-09T18:07:14.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:14.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:14.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:14.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.781+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800f670 legacy=0x7f816800fa80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:14.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.982+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:14.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.982+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:14.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:14.982+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800f670 legacy=0x7f816800fa80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:15.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:15.383+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:15.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:15.383+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:15.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:15.383+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800f670 legacy=0x7f816800fa80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:16.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:16.184+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:16.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:16.184+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:16.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:16.184+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800f670 legacy=0x7f816800fa80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:17.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:17.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:17.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:17.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:17.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:17.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:17.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800f670 legacy=0x7f816800fa80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:17.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 10 monclient: _add_conns ranks=[4,0,3,2,1] 2024-04-09T18:07:17.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:17.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168010e40 addr v2:172.21.15.173:3300/0 2024-04-09T18:07:17.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:07:17.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168007cb0 addr v1:172.21.15.29:6789/0 2024-04-09T18:07:17.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:17.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800f670 addr v2:172.21.15.29:3300/0 2024-04-09T18:07:17.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f8168007cb0 2024-04-09T18:07:17.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:17.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800f670 2024-04-09T18:07:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168010e40 2024-04-09T18:07:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.781+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.982+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.982+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.982+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:17.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.982+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:17.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:17.982+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:18.383+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:18.383+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:18.383+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:18.383+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:18.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:18.383+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:19.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:19.184+0000 7f818a2da640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:19.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:19.184+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:19.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:19.184+0000 7f818a2da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:19.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:19.184+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:19.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:19.184+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:20.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:20.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 msgr2=0x7f81680097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:20.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e40 0x7f81680097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:20.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800f670 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:20.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800f670 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:20.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:20.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 10 monclient: _add_conns ranks=[2,1] 2024-04-09T18:07:20.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168009e20 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:07:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f816800ff90 addr v1:172.21.15.173:6789/0 2024-04-09T18:07:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f816800ff90 2024-04-09T18:07:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168009e20 2024-04-09T18:07:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.782+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800ff90 legacy=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:20.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.983+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:20.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.983+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:20.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:20.983+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800ff90 legacy=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:21.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:21.384+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:21.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:21.384+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:21.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:21.384+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800ff90 legacy=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:22.185+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:22.185+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:22.185+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800ff90 legacy=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:23.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:23.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:23.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:23.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:23.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:23.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:23.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800ff90 legacy=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:23.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2024-04-09T18:07:23.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168007cb0 addr v1:172.21.15.29:6789/0 2024-04-09T18:07:23.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:23.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:07:23.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168009e20 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:07:23.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f670 0x7f816800ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:23.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f816800f670 addr v2:172.21.15.173:3300/0 2024-04-09T18:07:23.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f8168007cb0 2024-04-09T18:07:23.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:23.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800f670 2024-04-09T18:07:23.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:23.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168009e20 2024-04-09T18:07:23.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:23.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:23.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:23.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:23.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800f670 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:23.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.782+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f670 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.983+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.983+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.983+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.983+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800f670 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:23.983+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f670 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:24.384+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:24.384+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:24.384+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:24.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:24.384+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800f670 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:24.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:24.384+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f670 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:25.185+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:25.185+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:25.185+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:25.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:25.185+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800f670 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:25.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:25.185+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f670 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:26.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:26.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:26.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:26.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:26.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 msgr2=0x7f816800fa50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:26.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009e20 0x7f816800fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:26.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800f670 msgr2=0x7f816800ff90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:26.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800f670 0x7f816800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:26.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:26.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 10 monclient: _add_conns ranks=[1,3] 2024-04-09T18:07:26.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8168009770 addr v1:172.21.15.173:6789/0 2024-04-09T18:07:26.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800afc0 addr v2:172.21.15.29:3300/0 2024-04-09T18:07:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168009770 2024-04-09T18:07:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800afc0 2024-04-09T18:07:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.782+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009770 legacy=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:26.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.983+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:26.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.983+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:26.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:26.983+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009770 legacy=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:27.384+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:27.384+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:27.384+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009770 legacy=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:28.185+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:28.185+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:28.185+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009770 legacy=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009770 legacy=0x7f8168010900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2024-04-09T18:07:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:07:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800afc0 addr v2:172.21.15.29:3300/0 2024-04-09T18:07:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8168009770 addr v1:172.21.15.173:6789/0 2024-04-09T18:07:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f816800f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168007cb0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:07:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f8168009770 2024-04-09T18:07:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800afc0 2024-04-09T18:07:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168007cb0 2024-04-09T18:07:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:29.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:29.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.783+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009770 legacy=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:29.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.984+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:29.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.984+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:29.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.984+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:29.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.984+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:29.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:29.984+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009770 legacy=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:30.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:30.385+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:30.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:30.385+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:30.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:30.385+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:30.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:30.385+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:30.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:30.385+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009770 legacy=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:31.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:31.186+0000 7f818a2da640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:31.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:31.186+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:31.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:31.186+0000 7f818a2da640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:31.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:31.186+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:31.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:31.186+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009770 legacy=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:32.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:32.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:32.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:32.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:32.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:32.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f816800f670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:32.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:32.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:32.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009770 legacy=0x7f8168010900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:32.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 10 monclient: _add_conns ranks=[0,4] 2024-04-09T18:07:32.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168009e20 addr v1:172.21.15.29:6789/0 2024-04-09T18:07:32.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f81680186a0 0x7f816801aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:32.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f81680186a0 addr v2:172.21.15.173:3300/0 2024-04-09T18:07:32.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168009e20 2024-04-09T18:07:32.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:32.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f81680186a0 2024-04-09T18:07:32.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:32.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009e20 legacy=0x7f816800fbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:32.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f81680186a0 msgr2=0x7f816801aa90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:32.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.782+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f81680186a0 0x7f816801aa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:32.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.983+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009e20 legacy=0x7f816800fbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:32.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.983+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f81680186a0 msgr2=0x7f816801aa90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:32.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:32.983+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f81680186a0 0x7f816801aa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:33.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:33.384+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009e20 legacy=0x7f816800fbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:33.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:33.384+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f81680186a0 msgr2=0x7f816801aa90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:33.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:33.384+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f81680186a0 0x7f816801aa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:34.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:34.185+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009e20 legacy=0x7f816800fbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:34.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:34.185+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f81680186a0 msgr2=0x7f816801aa90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:34.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:34.185+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f81680186a0 0x7f816801aa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:35.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:35.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:35.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f81680186a0 msgr2=0x7f816801aa90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:35.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f81680186a0 0x7f816801aa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009e20 legacy=0x7f816800fbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2024-04-09T18:07:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:07:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800afc0 addr v2:172.21.15.29:3300/0 2024-04-09T18:07:35.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f8168010900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:35.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168007cb0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:07:35.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168009770 addr v1:172.21.15.29:6789/0 2024-04-09T18:07:35.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:35.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f8168009770 2024-04-09T18:07:35.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:35.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800afc0 2024-04-09T18:07:35.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:35.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168007cb0 2024-04-09T18:07:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009770 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.783+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.984+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.984+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.984+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009770 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.984+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:35.984+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:36.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:36.385+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009770 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:36.385+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:36.385+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:36.385+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:36.385+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:37.186+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:37.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:37.186+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:37.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:37.186+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009770 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:37.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:37.186+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:37.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:37.186+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f8168010900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f8168010900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 msgr2=0x7f816800b3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800afc0 0x7f816800b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009770 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 10 monclient: _add_conns ranks=[1,4] 2024-04-09T18:07:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8168010e40 addr v1:172.21.15.173:6789/0 2024-04-09T18:07:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009d40 0x7f816801a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168009d40 addr v2:172.21.15.173:3300/0 2024-04-09T18:07:38.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168010e40 2024-04-09T18:07:38.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:38.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168009d40 2024-04-09T18:07:38.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:38.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009d40 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:38.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:38.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.783+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009d40 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.984+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009d40 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.984+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:38.984+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009d40 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:39.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:39.385+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:39.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:39.385+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009d40 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:39.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:39.385+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009d40 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:40.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:40.186+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009d40 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:40.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:40.186+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:40.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:40.186+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009d40 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:41.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:41.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:41.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:41.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:41.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009d40 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009d40 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2024-04-09T18:07:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8168010e40 addr v1:172.21.15.173:6789/0 2024-04-09T18:07:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:07:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168007cb0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:07:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168009770 addr v1:172.21.15.29:6789/0 2024-04-09T18:07:41.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f8168009770 2024-04-09T18:07:41.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168010e40 2024-04-09T18:07:41.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:41.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168007cb0 2024-04-09T18:07:41.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:41.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:41.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009770 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:41.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:41.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.783+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:41.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.984+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009770 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:41.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.984+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:41.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.984+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:41.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:41.984+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:42.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:42.385+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:42.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:42.385+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009770 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:42.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:42.385+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:42.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:42.385+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:43.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:43.186+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009770 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:43.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:43.186+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:43.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:43.186+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:43.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:43.186+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:44.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:44.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:44.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:44.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:44.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:44.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009770 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 10 monclient: _add_conns ranks=[3,4] 2024-04-09T18:07:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f816800b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f8168009d40 addr v2:172.21.15.29:3300/0 2024-04-09T18:07:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800afc0 0x7f816801a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f816800afc0 addr v2:172.21.15.173:3300/0 2024-04-09T18:07:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168009d40 2024-04-09T18:07:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f816800afc0 2024-04-09T18:07:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 msgr2=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f816800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800afc0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.783+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800afc0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:44.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.984+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 msgr2=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:44.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.984+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f816800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:44.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.984+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800afc0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:44.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:44.984+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800afc0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:45.385+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 msgr2=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:45.385+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f816800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:45.385+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800afc0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:45.385+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800afc0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:46.186+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 msgr2=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:46.186+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f816800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:46.186+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800afc0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:46.186+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800afc0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f816800afc0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f816800afc0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 msgr2=0x7f816800b3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f816800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 10 monclient: _add_conns ranks=[1,4,0,3,2] 2024-04-09T18:07:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:07:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8168010e40 addr v1:172.21.15.173:6789/0 2024-04-09T18:07:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168007cb0 addr v2:172.21.15.173:3300/0 2024-04-09T18:07:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168009d40 addr v1:172.21.15.29:6789/0 2024-04-09T18:07:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8168005480 con 0x7f8168009d40 2024-04-09T18:07:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f8168010e40 2024-04-09T18:07:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168007cb0 2024-04-09T18:07:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.784+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:47.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.985+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:47.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.985+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:47.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.985+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:47.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:47.985+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:48.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:48.386+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:48.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:48.386+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:48.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:48.386+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:48.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:48.386+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:49.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:49.187+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:49.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:49.187+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:49.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:49.187+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:49.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:49.187+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:50.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:50.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:50.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:50.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:50.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:50.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:50.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:50.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:50.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 10 monclient: _add_conns ranks=[2,3] 2024-04-09T18:07:50.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009750 0x7f816800afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:50.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168009750 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:07:50.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:50.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800b500 addr v2:172.21.15.29:3300/0 2024-04-09T18:07:50.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:50.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800b500 2024-04-09T18:07:50.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:50.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168009750 2024-04-09T18:07:50.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:50.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009750 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:50.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:50.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009750 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:50.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.784+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:50.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.985+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009750 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.985+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.985+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009750 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:50.985+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:51.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:51.386+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009750 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:51.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:51.386+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:51.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:51.386+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009750 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:51.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:51.386+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:52.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:52.187+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009750 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:52.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:52.187+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:52.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:52.187+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009750 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:52.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:52.187+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:53.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:53.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:53.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:53.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:53.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009750 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:53.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168009750 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:53.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:53.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:53.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 10 monclient: _add_conns ranks=[4,3,0,2,1] 2024-04-09T18:07:53.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:53.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168007cb0 addr v2:172.21.15.173:3300/0 2024-04-09T18:07:53.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:53.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:07:53.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800b500 addr v2:172.21.15.29:3300/0 2024-04-09T18:07:53.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168009d40 addr v1:172.21.15.29:6789/0 2024-04-09T18:07:53.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168009d40 2024-04-09T18:07:53.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:53.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800b500 2024-04-09T18:07:53.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:53.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168007cb0 2024-04-09T18:07:53.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:53.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:53.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:53.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:53.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:53.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.785+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:53.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.986+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:53.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.986+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:53.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.986+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:53.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.986+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:53.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:53.986+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:54.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:54.387+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:54.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:54.387+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:54.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:54.387+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:54.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:54.387+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:54.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:54.387+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:55.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:55.188+0000 7f818a2da640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:07:55.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:55.188+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:55.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:55.188+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:55.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:55.188+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:07:55.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:55.188+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:56.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:56.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:56.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:56.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:56.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f81680108e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:56.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f81680108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:56.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:56.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b500 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:56.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:56.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 10 monclient: _add_conns ranks=[2,1] 2024-04-09T18:07:56.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:56.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168010e40 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:07:56.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8168009750 addr v1:172.21.15.173:6789/0 2024-04-09T18:07:56.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8168005480 con 0x7f8168009750 2024-04-09T18:07:56.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:56.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168010e40 2024-04-09T18:07:56.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:56.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:56.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:56.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.785+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009750 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:56.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.986+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:56.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.986+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:56.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:56.986+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009750 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:57.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:57.387+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:57.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:57.387+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:07:57.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:57.387+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009750 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:58.188+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:58.188+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:07:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:58.188+0000 7f81892d8640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009750 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:59.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:07:59.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:07:59.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:07:59.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:07:59.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:59.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:07:59.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009750 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:07:59.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 10 monclient: _add_conns ranks=[2,3,1,0,4] 2024-04-09T18:07:59.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:59.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:07:59.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168010e40 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:07:59.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f81680108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:07:59.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f8168009d40 addr v2:172.21.15.29:3300/0 2024-04-09T18:07:59.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f816800b500 addr v1:172.21.15.173:6789/0 2024-04-09T18:07:59.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:59.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f816800b500 2024-04-09T18:07:59.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:59.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168009d40 2024-04-09T18:07:59.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:07:59.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:59.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168010e40 2024-04-09T18:07:59.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:07:59.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:59.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:07:59.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.785+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800b500 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:07:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.986+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:07:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.986+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.986+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:07:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.986+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:07:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:07:59.986+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800b500 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:00.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:00.387+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:00.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:00.387+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:00.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:00.387+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:00.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:00.387+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:00.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:00.387+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800b500 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:01.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:01.188+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:01.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:01.188+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:01.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:01.188+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:01.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:01.188+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:01.188+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800b500 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:02.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:08:02.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:08:02.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:08:02.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:08:02.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:02.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:02.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:02.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009d40 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:02.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800b500 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:02.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 10 monclient: _add_conns ranks=[0,4] 2024-04-09T18:08:02.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168009750 addr v1:172.21.15.29:6789/0 2024-04-09T18:08:02.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f816801a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:02.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168007cb0 addr v2:172.21.15.173:3300/0 2024-04-09T18:08:02.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8168005480 con 0x7f8168009750 2024-04-09T18:08:02.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:02.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168007cb0 2024-04-09T18:08:02.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:08:02.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009750 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:02.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:02.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.786+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:02.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.987+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009750 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:02.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.987+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:02.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:02.987+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:03.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:03.388+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009750 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:03.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:03.388+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:03.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:03.388+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:04.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:04.189+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009750 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:04.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:04.189+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:04.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:04.189+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:05.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:08:05.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:08:05.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:08:05.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:08:05.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:05.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168007cb0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:05.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168009750 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:05.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2024-04-09T18:08:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:08:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168010e40 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:08:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168007cb0 addr v1:172.21.15.29:6789/0 2024-04-09T18:08:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8168009d40 addr v1:172.21.15.173:6789/0 2024-04-09T18:08:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168007cb0 2024-04-09T18:08:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8168005480 con 0x7f8168009d40 2024-04-09T18:08:05.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:05.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168010e40 2024-04-09T18:08:05.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:05.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:08:05.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.786+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:05.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.787+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:05.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.987+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:05.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.987+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:05.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.987+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:05.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:05.988+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:06.388+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:06.388+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:06.388+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:06.389+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:07.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:07.189+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:07.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:07.189+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:07.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:07.189+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:07.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:07.190+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:08:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:08:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:08:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:08:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 10 monclient: _add_conns ranks=[4,3] 2024-04-09T18:08:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168009750 addr v2:172.21.15.173:3300/0 2024-04-09T18:08:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800b4e0 addr v2:172.21.15.29:3300/0 2024-04-09T18:08:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800b4e0 2024-04-09T18:08:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168009750 2024-04-09T18:08:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:08:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.787+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:08.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.988+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:08.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.988+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:08.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.988+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:08.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:08.988+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:09.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:09.389+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:09.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:09.389+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:09.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:09.389+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:09.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:09.389+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:10.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:10.190+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:10.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:10.190+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:10.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:10.190+0000 7f8189ad9640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:10.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:10.190+0000 7f8189ad9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:08:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:08:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:08:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:08:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 10 monclient: _add_conns ranks=[0,3,4,2,1] 2024-04-09T18:08:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168007cb0 addr v1:172.21.15.29:6789/0 2024-04-09T18:08:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:08:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800b4e0 addr v2:172.21.15.29:3300/0 2024-04-09T18:08:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168009750 addr v2:172.21.15.173:3300/0 2024-04-09T18:08:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f8168007cb0 2024-04-09T18:08:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:11.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:11.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800b4e0 2024-04-09T18:08:11.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:11.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168009750 2024-04-09T18:08:11.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:08:11.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:11.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.787+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:11.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.988+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:11.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.988+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:11.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.988+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:11.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.988+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:11.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:11.988+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:12.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:12.389+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:12.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:12.389+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:12.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:12.389+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:12.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:12.389+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:12.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:12.389+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:13.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:13.190+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:13.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:13.190+0000 7f81892d8640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:13.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:13.190+0000 7f81892d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:13.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:13.190+0000 7f818a2da640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:13.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:13.190+0000 7f818a2da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:14.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:08:14.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:08:14.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:08:14.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:08:14.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:14.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:14.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:14.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:14.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168007cb0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:14.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 10 monclient: _add_conns ranks=[1,2] 2024-04-09T18:08:14.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8168009d40 addr v1:172.21.15.173:6789/0 2024-04-09T18:08:14.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:14.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168010e40 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:08:14.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168009d40 2024-04-09T18:08:14.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:14.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168010e40 2024-04-09T18:08:14.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:08:14.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:14.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:14.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.787+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:14.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.988+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:14.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.988+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:14.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:14.988+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:15.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:15.389+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:15.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:15.389+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:15.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:15.389+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:16.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:16.190+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:16.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:16.190+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:16.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:16.190+0000 7f8189ad9640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:17.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:08:17.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:08:17.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:08:17.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:08:17.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:17.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168010e40 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:17.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:17.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 10 monclient: _add_conns ranks=[3,2,1,0,4] 2024-04-09T18:08:17.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:17.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:08:17.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f816800b4e0 addr v2:172.21.15.29:3300/0 2024-04-09T18:08:17.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:17.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168007cb0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:08:17.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8168009d40 addr v1:172.21.15.173:6789/0 2024-04-09T18:08:17.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f8168009d40 2024-04-09T18:08:17.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:17.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:17.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f816800b4e0 2024-04-09T18:08:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168007cb0 2024-04-09T18:08:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:08:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.788+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.989+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.989+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.989+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.989+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:17.989+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:18.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:18.390+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:18.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:18.390+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:18.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:18.390+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:18.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:18.390+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:18.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:18.390+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:19.191+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:19.191+0000 7f81892d8640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:19.191+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:19.191+0000 7f81892d8640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:19.191+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:20.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:08:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:08:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:08:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:08:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 msgr2=0x7f816801a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f816800b4e0 0x7f816801a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f8168009d40 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 10 monclient: _add_conns ranks=[0,4] 2024-04-09T18:08:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8168010e40 addr v1:172.21.15.29:6789/0 2024-04-09T18:08:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f816800afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168009750 addr v2:172.21.15.173:3300/0 2024-04-09T18:08:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f8168010e40 2024-04-09T18:08:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168009750 2024-04-09T18:08:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:08:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.788+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:20.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.989+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:20.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.989+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:20.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:20.989+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:21.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:21.390+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:21.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:21.390+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:21.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:21.390+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:22.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:22.191+0000 7f8189ad9640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:22.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:22.191+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:22.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:22.191+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:23.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:08:23.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:08:23.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:08:23.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:08:23.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 msgr2=0x7f816800afa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:23.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168009750 0x7f816800afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:23.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f8168010e40 legacy=0x7f816800fd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:23.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 10 monclient: _add_conns ranks=[2,4,1,0,3] 2024-04-09T18:08:23.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:23.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f818a2da640 1 -- reap_dead start 2024-04-09T18:08:23.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8168007cb0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-04-09T18:08:23.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e20 0x7f8168009d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:23.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8168010e20 addr v2:172.21.15.173:3300/0 2024-04-09T18:08:23.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f816800afa0 addr v1:172.21.15.173:6789/0 2024-04-09T18:08:23.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406fb30 con 0x7f816800afa0 2024-04-09T18:08:23.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:23.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168010e20 2024-04-09T18:08:23.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:23.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:23.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406ed30 con 0x7f8168007cb0 2024-04-09T18:08:23.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:08:23.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:23.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afa0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:23.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.788+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e20 msgr2=0x7f8168009d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:23.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.789+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e20 0x7f8168009d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.989+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.989+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:23.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.990+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e20 msgr2=0x7f8168009d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:23.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.990+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afa0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:23.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:23.990+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e20 0x7f8168009d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:24.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:24.390+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:24.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:24.390+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:24.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:24.391+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afa0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:24.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:24.391+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e20 msgr2=0x7f8168009d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:24.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:24.391+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e20 0x7f8168009d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:25.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:25.191+0000 7f8189ad9640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3301/0 2024-04-09T18:08:25.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:25.191+0000 7f8189ad9640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:25.192+0000 7f818a2da640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afa0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-04-09T18:08:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:25.192+0000 7f81892d8640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e20 msgr2=0x7f8168009d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-04-09T18:08:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:25.192+0000 7f81892d8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e20 0x7f8168009d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:26.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 10 monclient(hunting): tick 2024-04-09T18:08:26.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-09T18:08:26.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 1 monclient(hunting): continuing hunt 2024-04-09T18:08:26.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-09T18:08:26.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 1 -- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 msgr2=0x7f81680108b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:26.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8168007cb0 0x7f81680108b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:26.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e20 msgr2=0x7f8168009d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:26.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8168010e20 0x7f8168009d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-09T18:08:26.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f816800afa0 legacy=0x7f816800f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-09T18:08:26.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 10 monclient: _add_conns ranks=[3,0] 2024-04-09T18:08:26.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009750 0x7f816800b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-09T18:08:26.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f8168009750 addr v2:172.21.15.29:3300/0 2024-04-09T18:08:26.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f816800fd80 addr v1:172.21.15.29:6789/0 2024-04-09T18:08:26.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840af7f0 con 0x7f816800fd80 2024-04-09T18:08:26.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 10 monclient(hunting): start opening mon connection 2024-04-09T18:08:26.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840ae1d0 con 0x7f8168009750 2024-04-09T18:08:26.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.788+0000 7f817b7fe640 10 monclient(hunting): _renew_subs 2024-04-09T18:08:26.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.789+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009750 msgr2=0x7f816800b380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:26.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.789+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f816800fd80 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:26.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.789+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009750 0x7f816800b380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-09T18:08:26.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.990+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009750 msgr2=0x7f816800b380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:26.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.990+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f816800fd80 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:26.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:26.990+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009750 0x7f816800b380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-09T18:08:27.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:27.391+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009750 msgr2=0x7f816800b380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:27.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:27.391+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f816800fd80 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:27.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:27.391+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009750 0x7f816800b380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-09T18:08:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:28.192+0000 7f8189ad9640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7f8168009750 msgr2=0x7f816800b380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-09T18:08:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:28.192+0000 7f81892d8640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7f816800fd80 legacy=0x7f81680196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-09T18:08:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-09T18:08:28.192+0000 7f8189ad9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8168009750 0x7f816800b380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-09T18:08:29.687 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-09T18:08:29.688 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2764, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2596, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2362, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1616, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1607, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-04-09T18:08:29.699 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-09T18:08:29.699 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-09T18:08:29.699 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-09T18:08:29.699 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.702 INFO:tasks.ceph.osd.0:Stopped 2024-04-09T18:08:29.702 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-09T18:08:29.702 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.703 INFO:tasks.ceph.osd.1:Stopped 2024-04-09T18:08:29.703 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-09T18:08:29.703 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.703 INFO:tasks.ceph.osd.2:Stopped 2024-04-09T18:08:29.703 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-09T18:08:29.703 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.703 INFO:tasks.ceph.osd.3:Stopped 2024-04-09T18:08:29.704 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-09T18:08:29.704 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.704 INFO:tasks.ceph.osd.4:Stopped 2024-04-09T18:08:29.704 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-09T18:08:29.704 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.704 INFO:tasks.ceph.osd.5:Stopped 2024-04-09T18:08:29.704 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-09T18:08:29.704 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.705 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-09T18:08:29.705 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2764, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2596, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2362, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1616, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1607, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi173 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6" 2024-04-09T18:08:29.714 INFO:tasks.ceph.osd.6:Stopped 2024-04-09T18:08:29.715 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-09T18:08:29.715 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.715 INFO:tasks.ceph.osd.7:Stopped 2024-04-09T18:08:29.715 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-09T18:08:29.715 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-09T18:08:29.715 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-09T18:08:29.715 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2764, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2596, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2362, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1616, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1607, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y' 2024-04-09T18:08:29.725 INFO:tasks.ceph.mgr.y:Stopped 2024-04-09T18:08:29.725 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-09T18:08:29.726 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.726 INFO:tasks.ceph.mgr.x:Stopped 2024-04-09T18:08:29.726 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-09T18:08:29.726 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-09T18:08:29.726 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.726 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-09T18:08:29.726 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2764, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2596, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2362, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1616, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1607, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-04-09T18:08:29.736 INFO:tasks.ceph.mon.a:Stopped 2024-04-09T18:08:29.737 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-09T18:08:29.737 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.737 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-09T18:08:29.737 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2764, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2596, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2362, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1616, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1607, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-04-09T18:08:29.747 INFO:tasks.ceph.mon.c:Stopped 2024-04-09T18:08:29.747 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-09T18:08:29.747 INFO:teuthology.orchestra.run:waiting for 300 2024-04-09T18:08:29.747 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-09T18:08:29.747 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2764, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2596, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2362, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1616, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1607, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi173 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-04-09T18:08:29.758 INFO:tasks.ceph.mon.b:Stopped 2024-04-09T18:08:29.758 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-09T18:08:29.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | head -n 1 2024-04-09T18:08:29.799 INFO:teuthology.orchestra.run.smithi029.stdout:2024-04-09T12:11:12.743967+0000 mon.a (mon.0) 750 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-04-09T18:08:29.800 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-04-09T18:08:29.800 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-09T18:08:29.800 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-09T18:08:29.902 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-09T18:08:29.902 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-09T18:08:29.984 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-09T18:08:29.985 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-09T18:08:30.062 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-09T18:08:30.062 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-09T18:08:30.169 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-09T18:08:30.170 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-09T18:08:30.336 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-09T18:08:30.337 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-09T18:08:30.398 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-09T18:08:30.398 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-09T18:08:30.465 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-09T18:08:30.465 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-09T18:08:30.523 INFO:tasks.ceph:Archiving mon data... 2024-04-09T18:08:30.524 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/data/mon.a.tgz 2024-04-09T18:08:30.525 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-09T18:08:30.541 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.CHPiFOVmS3 2024-04-09T18:08:30.541 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.CHPiFOVmS3 2024-04-09T18:08:30.728 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.CHPiFOVmS3 2024-04-09T18:08:30.812 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.CHPiFOVmS3 is 526KB 2024-04-09T18:08:30.921 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.CHPiFOVmS3 2024-04-09T18:08:30.936 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/data/mon.c.tgz 2024-04-09T18:08:30.937 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-09T18:08:30.989 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.K0wsI3DCTi 2024-04-09T18:08:30.990 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.K0wsI3DCTi 2024-04-09T18:08:31.165 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.K0wsI3DCTi 2024-04-09T18:08:31.250 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.K0wsI3DCTi is 526KB 2024-04-09T18:08:31.349 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.K0wsI3DCTi 2024-04-09T18:08:31.363 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/data/mon.b.tgz 2024-04-09T18:08:31.363 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-04-09T18:08:31.382 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.BLJ3d2RohC 2024-04-09T18:08:31.382 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BLJ3d2RohC 2024-04-09T18:08:31.576 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.BLJ3d2RohC 2024-04-09T18:08:31.662 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.BLJ3d2RohC is 526KB 2024-04-09T18:08:31.730 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.BLJ3d2RohC 2024-04-09T18:08:31.744 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-09T18:08:31.745 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-09T18:08:31.747 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-09T18:08:31.811 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-09T18:08:31.812 DEBUG:teuthology.orchestra.run.smithi029:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-09T18:08:31.815 DEBUG:teuthology.orchestra.run.smithi173:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-09T18:08:31.856 INFO:teuthology.orchestra.run.smithi029.stdout:/var/log/ceph/valgrind/mon.a.log: Leak_StillReachable 2024-04-09T18:08:31.857 INFO:teuthology.orchestra.run.smithi029.stdout:/var/log/ceph/valgrind/mon.c.log: Leak_StillReachable 2024-04-09T18:08:31.857 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.a.log kind Leak_StillReachable 2024-04-09T18:08:31.857 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.a.log 2024-04-09T18:08:31.860 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.c.log kind Leak_StillReachable 2024-04-09T18:08:31.861 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.c.log 2024-04-09T18:08:31.893 INFO:teuthology.orchestra.run.smithi173.stdout:/var/log/ceph/valgrind/mon.b.log: Leak_StillReachable 2024-04-09T18:08:31.893 INFO:teuthology.orchestra.run.smithi173.stdout:/var/log/ceph/valgrind/osd.6.log: Leak_PossiblyLost 2024-04-09T18:08:31.893 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.b.log kind Leak_StillReachable 2024-04-09T18:08:31.893 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.b.log 2024-04-09T18:08:31.896 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/osd.6.log kind Leak_PossiblyLost 2024-04-09T18:08:31.897 ERROR:tasks.ceph:saw valgrind issue Leak_PossiblyLost in /var/log/ceph/valgrind/osd.6.log 2024-04-09T18:08:31.901 INFO:tasks.ceph:Archiving crash dumps... 2024-04-09T18:08:31.902 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/remote/smithi029/crash 2024-04-09T18:08:31.903 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-09T18:08:31.930 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/remote/smithi173/crash 2024-04-09T18:08:31.931 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-09T18:08:32.005 INFO:tasks.ceph:Compressing logs... 2024-04-09T18:08:32.005 DEBUG:teuthology.orchestra.run.smithi029:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-09T18:08:32.008 DEBUG:teuthology.orchestra.run.smithi173:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-09T18:08:52.795 INFO:tasks.ceph:Archiving logs... 2024-04-09T18:08:52.796 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/remote/smithi029/log 2024-04-09T18:08:52.797 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-09T18:08:55.323 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/remote/smithi173/log 2024-04-09T18:08:55.324 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-09T18:08:57.326 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 322, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2764, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2596, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2362, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1616, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1607, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1951, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 362, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2024-04-09T18:08:57.344 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-09T18:08:57.353 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 322, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2764, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2596, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2362, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1616, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1607, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1951, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 362, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2024-04-09T18:08:57.359 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-09T18:08:57.359 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-09T18:08:57.366 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-09T18:08:57.446 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-09T18:08:57.455 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-09T18:08:57.456 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-09T18:08:57.458 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-09T18:08:57.471 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-04-09T18:08:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-04-09T18:08:57.477 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-09T18:08:57.477 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-04-09T18:08:57.477 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 35 -548us[ -548us] +/- 80ms 2024-04-09T18:08:57.477 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv02.front.sepia.ceph.com 3 8 377 168 -355us[ -389us] +/- 76ms 2024-04-09T18:08:57.477 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 35 +994us[ +994us] +/- 84ms 2024-04-09T18:08:57.477 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-09T18:08:57.478 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-09T18:08:57.479 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-04-09T18:08:57.479 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 -583us[ -583us] +/- 80ms 2024-04-09T18:08:57.479 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv02.front.sepia.ceph.com 3 7 377 99 -399us[ -395us] +/- 77ms 2024-04-09T18:08:57.479 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 154 +932us[ +940us] +/- 83ms 2024-04-09T18:08:57.479 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-09T18:08:57.480 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-09T18:08:57.489 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-09T18:08:57.489 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-09T18:08:57.498 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-09T18:08:57.591 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-09T18:08:57.665 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-09T18:08:57.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-09T18:08:57.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-09T18:08:57.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-09T18:08:57.728 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-09T18:08:57.737 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-09T18:08:57.745 INFO:teuthology.task.internal:Duration was 22875.478806 seconds 2024-04-09T18:08:57.746 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-09T18:08:57.756 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-09T18:08:57.756 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-09T18:08:57.759 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-09T18:08:57.803 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-09T18:08:57.812 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-09T18:08:58.155 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-09T18:08:58.155 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-04-09T18:08:58.156 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-09T18:08:58.177 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-04-09T18:08:58.177 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-09T18:08:58.212 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-09T18:08:58.213 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-09T18:08:58.220 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-09T18:08:58.281 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-09T18:08:58.281 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-09T18:08:58.291 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-09T18:08:58.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-09T18:08:58.450 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-09T18:08:58.450 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-09T18:08:58.477 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-09T18:08:58.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-09T18:08:58.513 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-09T18:08:58.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-09T18:08:58.541 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-04-09T18:08:58.570 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-04-09T18:08:58.598 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-09T18:08:58.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-09T18:08:58.620 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-09T18:08:58.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-09T18:08:58.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-09T18:08:58.663 INFO:teuthology.task.internal:Transferring archived files... 2024-04-09T18:08:58.664 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/remote/smithi029 2024-04-09T18:08:58.664 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-09T18:08:58.699 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/remote/smithi173 2024-04-09T18:08:58.699 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-09T18:08:58.734 INFO:teuthology.task.internal:Removing archive directory... 2024-04-09T18:08:58.734 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-09T18:08:58.737 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-09T18:08:58.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-09T18:08:58.793 INFO:teuthology.task.internal:Not uploading archives. 2024-04-09T18:08:58.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-09T18:08:58.851 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-09T18:08:58.851 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-09T18:08:58.853 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-09T18:08:58.865 INFO:teuthology.orchestra.run.smithi029.stdout: 265316 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 9 18:08 /home/ubuntu/cephtest 2024-04-09T18:08:58.866 INFO:teuthology.orchestra.run.smithi029.stdout: 393555 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 9 12:05 /home/ubuntu/cephtest/mnt.0 2024-04-09T18:08:58.866 INFO:teuthology.orchestra.run.smithi029.stdout: 393556 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 9 12:06 /home/ubuntu/cephtest/mnt.0/client.0 2024-04-09T18:08:58.866 INFO:teuthology.orchestra.run.smithi029.stdout: 407512 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 9 12:06 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-09T18:08:58.866 INFO:teuthology.orchestra.run.smithi029.stdout: 407524 12 -rw-r--r-- 1 ubuntu ubuntu 11826 Apr 9 12:22 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_tier_pp.log 2024-04-09T18:08:58.866 INFO:teuthology.orchestra.run.smithi029.stdout: 407528 4 -rw-r--r-- 1 ubuntu ubuntu 1280 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat_pp.log 2024-04-09T18:08:58.866 INFO:teuthology.orchestra.run.smithi029.stdout: 407518 4 -rw-r--r-- 1 ubuntu ubuntu 1871 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock.log 2024-04-09T18:08:58.866 INFO:teuthology.orchestra.run.smithi029.stdout: 407536 4 -rw-r--r-- 1 ubuntu ubuntu 1715 Apr 9 12:08 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_read_operations.log 2024-04-09T18:08:58.867 INFO:teuthology.orchestra.run.smithi029.stdout: 407538 8 -rw-r--r-- 1 ubuntu ubuntu 5573 Apr 9 12:11 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_list_parallel.log 2024-04-09T18:08:58.867 INFO:teuthology.orchestra.run.smithi029.stdout: 407522 8 -rw-r--r-- 1 ubuntu ubuntu 4272 Apr 9 12:14 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc_pp.log 2024-04-09T18:08:58.867 INFO:teuthology.orchestra.run.smithi029.stdout: 407513 4 -rw-r--r-- 1 ubuntu ubuntu 4041 Apr 9 12:15 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio.log 2024-04-09T18:08:58.867 INFO:teuthology.orchestra.run.smithi029.stdout: 407520 4 -rw-r--r-- 1 ubuntu ubuntu 2730 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc.log 2024-04-09T18:08:58.867 INFO:teuthology.orchestra.run.smithi029.stdout: 407537 4 -rw-r--r-- 1 ubuntu ubuntu 423 Apr 9 12:07 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cls_remote_reads.log 2024-04-09T18:08:58.867 INFO:teuthology.orchestra.run.smithi029.stdout: 407529 4 -rw-r--r-- 1 ubuntu ubuntu 591 Apr 9 12:08 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd_pp.log 2024-04-09T18:08:58.867 INFO:teuthology.orchestra.run.smithi029.stdout: 407532 16 -rw-r--r-- 1 ubuntu ubuntu 14630 Apr 9 12:08 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd.log 2024-04-09T18:08:58.867 INFO:teuthology.orchestra.run.smithi029.stdout: 407531 4 -rw-r--r-- 1 ubuntu ubuntu 2722 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify.log 2024-04-09T18:08:58.868 INFO:teuthology.orchestra.run.smithi029.stdout: 407525 4 -rw-r--r-- 1 ubuntu ubuntu 2072 Apr 9 12:10 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots.log 2024-04-09T18:08:58.868 INFO:teuthology.orchestra.run.smithi029.stdout: 407517 120 -rw-r--r-- 1 ubuntu ubuntu 122600 Apr 9 12:07 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_asio.log 2024-04-09T18:08:58.868 INFO:teuthology.orchestra.run.smithi029.stdout: 407527 4 -rw-r--r-- 1 ubuntu ubuntu 1175 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat.log 2024-04-09T18:08:58.868 INFO:teuthology.orchestra.run.smithi029.stdout: 407539 4 -rw-r--r-- 1 ubuntu ubuntu 1295 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_delete_pools_parallel.log 2024-04-09T18:08:58.868 INFO:teuthology.orchestra.run.smithi029.stdout: 407534 4 -rw-r--r-- 1 ubuntu ubuntu 713 Apr 9 12:07 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service_pp.log 2024-04-09T18:08:58.868 INFO:teuthology.orchestra.run.smithi029.stdout: 407535 4 -rw-r--r-- 1 ubuntu ubuntu 1205 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_write_operations.log 2024-04-09T18:08:58.868 INFO:teuthology.orchestra.run.smithi029.stdout: 407533 4 -rw-r--r-- 1 ubuntu ubuntu 2031 Apr 9 12:06 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service.log 2024-04-09T18:08:58.868 INFO:teuthology.orchestra.run.smithi029.stdout: 407514 8 -rw-r--r-- 1 ubuntu ubuntu 5855 Apr 9 12:16 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio_pp.log 2024-04-09T18:08:58.869 INFO:teuthology.orchestra.run.smithi029.stdout: 407516 4 -rw-r--r-- 1 ubuntu ubuntu 3916 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io_pp.log 2024-04-09T18:08:58.869 INFO:teuthology.orchestra.run.smithi029.stdout: 407540 4 -rw-r--r-- 1 ubuntu ubuntu 1029 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_open_pools_parallel.log 2024-04-09T18:08:58.869 INFO:teuthology.orchestra.run.smithi029.stdout: 407530 8 -rw-r--r-- 1 ubuntu ubuntu 4137 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify_pp.log 2024-04-09T18:08:58.869 INFO:teuthology.orchestra.run.smithi029.stdout: 407521 4 -rw-r--r-- 1 ubuntu ubuntu 2018 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock_pp.log 2024-04-09T18:08:58.869 INFO:teuthology.orchestra.run.smithi029.stdout: 407523 4 -rw-r--r-- 1 ubuntu ubuntu 1241 Apr 9 12:07 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_pool.log 2024-04-09T18:08:58.869 INFO:teuthology.orchestra.run.smithi029.stdout: 407519 8 -rw-r--r-- 1 ubuntu ubuntu 7032 Apr 9 12:14 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_list.log 2024-04-09T18:08:58.869 INFO:teuthology.orchestra.run.smithi029.stdout: 407526 4 -rw-r--r-- 1 ubuntu ubuntu 3784 Apr 9 12:11 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots_pp.log 2024-04-09T18:08:58.869 INFO:teuthology.orchestra.run.smithi029.stdout: 407515 4 -rw-r--r-- 1 ubuntu ubuntu 2499 Apr 9 12:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io.log 2024-04-09T18:08:58.870 INFO:teuthology.orchestra.run.smithi173.stdout: 265306 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 9 18:08 /home/ubuntu/cephtest 2024-04-09T18:08:58.870 INFO:teuthology.orchestra.run.smithi173.stdout: 267176 732408 -rw------- 1 root root 752500736 Apr 9 12:29 /home/ubuntu/cephtest/vgcore.35530 2024-04-09T18:08:58.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-09T18:08:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-09T18:08:58.872 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 322, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2764, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2596, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 2362, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1616, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_manager.py", line 1607, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 1951, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph.py", line 362, in valgrind_post raise valgrind_exception Exception: saw valgrind issues During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-09T18:08:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-09T18:08:58.928 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-09T18:08:58.938 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-09T18:08:58.948 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: saw valgrind issues 2024-04-09T18:08:58.948 INFO:teuthology.nuke:Checking targets against current locks 2024-04-09T18:08:58.978 DEBUG:teuthology.nuke:shortname: smithi029 2024-04-09T18:08:58.978 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-09T18:08:58.998 DEBUG:teuthology.nuke:shortname: smithi173 2024-04-09T18:08:58.999 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-09T18:08:59.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-09 11:38:52.634389', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLd2rczFXtkBnExxc0wZ72DLZ2Oqx6t/y18wJm1SSm5q4Ov//fg3U+yoWqWxOembOfhrNsDo4XkL9WIYm6C+1s8='} 2024-04-09T18:08:59.015 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-09 11:38:52.631298', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMaUdtGkoG7u+mxCWB37j6LeAe+SEueeretaHrosLTHPOFvisXpgRARVqzn3jMm0wfpB3sEfQteZWNHSCb2ai7s='} 2024-04-09T18:08:59.053 INFO:teuthology.orchestra.console.smithi029:Power off 2024-04-09T18:08:59.054 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T18:08:59.069 INFO:teuthology.orchestra.console.smithi173:Power off 2024-04-09T18:08:59.069 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T18:08:59.085 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-04-09T18:08:59.085 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T18:08:59.095 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-04-09T18:08:59.095 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T18:08:59.109 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-04-09T18:08:59.118 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-04-09T18:09:03.110 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T18:09:03.119 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T18:09:03.221 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-04-09T18:09:03.229 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-04-09T18:09:07.226 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T18:09:07.235 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T18:09:07.338 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-04-09T18:09:07.344 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-04-09T18:09:07.439 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-04-09T18:09:07.445 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-04-09T18:09:07.551 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} duration: 22875.47880578041 failure_reason: 'Command failed (workunit test rados/test.sh) on smithi029 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7f18ee2c431c44ad972a61621d1c2393 status: fail success: false 2024-04-09T18:09:07.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T18:09:07.633 INFO:teuthology.run:FAIL